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Abstract of J P 8172624 (A) 

PROBLEM TO BE SOLVED: To decide whether or 
not an image is delayed by using a 1st, counter so 
as to keep a system time in a circuit and allowing a 
2nd counter to decide a display time error between 
the system time and its local copy. SOLUTION: A 
clock reference 253 is decoded by a system 
separator 254, and the decoded signal is fed to a 
1st counter 255 that counts a time incremented by a 
prescribed frequency, and also loaded to a 2nd 
counter 258 placed in a video decoder 270. Then a 
time stamp passes through a video buffer 271 , 
where it is delayed by a same amount as video 
data. They are compared next with a time local copy 
so that whether or not an image is faster or sfower is 
discriminated. The counter 255 keeps 3 system time 
in a 1st circuit and is synchronously with the counter 
258. Furthermore, the counter 258 keeps a local 
copy of the system time and decides a display time t • 
error with respect to the system time by cc 
the copy with Ihe time stamp. 
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WRtfTfcS»-r5ffifeaS?lilKtt3-K7-KCW* 
lESW&lftP- F7- F^iJt^tSc *©«Rtfffi 
ftftn- F7- FmBftS^fcfl UTJttfcBU <9«S 
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tt ©ffiV\Rtfffi^ffiH L fc e r ^"x- * ££4 fljSt 

isatffififtn- F7- vmcmh-zm-fvt 

7^±S&MM5fcn- F7- FOK&W£«ftfto£7 
K7-KCWStfX7-ttffl^i-y^lf7 F*^t? 0 * 
M^x^-^x7^0Ktffi»$ti§c ^Rtf 

10 [000 5] ioT, l ©3it#««^7> 

k t z 121 1 fev ^ t#©e b as* ffl ^ 5 n, mm 
mm® 

7'u 77:8^x8 F U 7 ^XH«, f ftfc* 6 
4©DCT Wn^>» (y-X, MJ- 

20 fiS«») : eyF*FU 

s^fefcp-r?. 2o«DfeMfi-^^^t'n^ 1 

«'»#;W4C rRtf C bT?£§o 

m : Wt%«1"5 3 ^© V F V 7 ^ X (»fi, Rtf 
30 2O0feS) ©V->-fn*MOA^©vbU7i'^, 7"D 

J±» : r-^iS@%gT/t*tffl^5»n§E > 7 m^v 
mmt (W : A*tl^fte7 FX h "J 

e > miumffx- y^~ 9^x-h xms. l /ciis t 

40 -T*5 0 

rtS W>h7) ll^ib : -v7a7'D7^X«{ic7)II 
^{bo ^©a^b«V7P7'p 7 7X«$H§fr?>/£tf© 

Sfi (fig») : e 7 F X F U - AO+TSS 

sftfetBi ug^<D#fiiMSb-r v h y 7 7* 
50 p-^xttitii. watfflo^ns^^wiYT 



11 

v 5 u 7'n 7 * : BWRoWfifiE^© 16x16 ©gp#fr 
e,£.VZ4"D<DBXS7vy<?amg.7 ! -*t, 20 
(4:2: o^av7*-V7 h) , 40(4:2:2 

{TDV7*-V7H , (4:4: 4^P-77 

»), «:©Kffl*ocioSP^T?£*/'c'»*^^^ (sy 
n t a x) ©v*n7ny*'vy$ffc£ft5ftfcH!M 

It ^7 h;l/ : a&©Kfi(DSgffillA^a«{^ffi 
#7n"*£ h;I/ 0 20 

<D8# n 1 4 U § v £ a 7*n 7 tfBMfcfr B OflW* t 

; P E L : BfeftQH £ 
Ktt : film *#Xtt«7cLfci!M»r-*. fll^SX 

8t*7 h»03O0fi^vhU7^^5*S. 7°a 
yi/rW^t(i 1 "OOWfiRtt 1 -D(D7V~L,K 
t§U\ft <<y$-U-7s\ZT*T*ltl-0<Dimtel-0 30 
©7U-A, T&^MfM»7b-A©«7^-/U 

^ffj : 5!££^{t2nT^3ii*€XttT-*JS#0JI 

S«5flW^T-'^ (R P S) : fgf$L/c b-* 

7 -fe-SM y ^-^©ff^C-IgW^^^^- -y h 40 
**-bn-K [**TAKtfeT*] : #-©ft^fb 
td'y hXbU-AtjfA^n§3 2H'7 KE>n-K„ J t 

^fift-^fb ; V L C : 

-H7-H*W»)aTfeSK:iBt5-r^yH!:fi^3- 
[0 0 0 6] 
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DATAh-*y*£-r*2«/W77<<>3'Xri»lC 

ifWSSFfsy (MSM) £#trer*#*T$fc, 1 
Itan^v^ (IDCT) *fflLfe7FU*$g 
ta-7 h*W1"5mSDR AM3>ho-7t SHE 

^m%t. Tv^yyv yymeTtz^^y? 

[0 0 0 7] MCSSftClfctt, 

(g) sm p e g VTtwwsmxmvzs 
£?dat a ] — $yit] — 9 vmar&m&xfT- $ m 

^ y tit Lrmmnmn h - 9 >£ffiinr § fcfc tpif 

LTiliSfJLfcDATAF-^y^fflg-rSct^^XT- 
s?*fSfta-T5o SMS©-*-*- MiJ^arAIUBfttf 

v9>WrVy9. t£T*1ffB©!B1I, M?iJa7W 

[0 0 0 8] WfcLT, SfejMStHSfSfefeTttft 

^AX?>7°^ H 1 ©SKftC^XrABfl^OT 
tetany ?gipi:, if 1 ©^^©S/XxABfP^ 
»lt5^P7 7g^©f31£&?1g 1 ^H*>7>? 
fc, ^©!glB#F^7y*^Jfi;£^/cSI2©@Egrt 
©ynyy^KJ^TSMb^ftS^s^y-y* 
fc£WLTR#fl©^»^ i/XrAB#F^<DD-*;l/ 
3^-%ftJ#U x-rAx^y7°t^2afK*7y^^ 
%Jtet5<: «fc D^XrAa#H©n-*;l/3t°-i: 
^XrABf^t©fS5)S^^^5>^X7-^St§ 

$>K%s{h7,$y?h, i/7.rAr3-^rt©i/XrA 
B#F^^»b-T 5 ^ D 7 XS^P fc, Arn-^rt 
©S^xARJH § ^ u 7 ^S¥t ©{eI^ST 

SllSIHIA^^fc, ^-©^lB#K*7>^t^^t 
o fcS 2 ©@Krt© X a 7 <fc o TSfflfk?n§ 

% 2 I^IB A »7 > # t V^T i/Xf At 3 - iHfetf e t 

tr-*ffi#L, ^^A7 > ^y7°t^2^*'7>^t^ 
J±«T3 C£fc£D^XrA^©n-A;l,nt°-^> 



(8) 

13 

[0009] zommmmt, % i ow^xx 
ab# H^sMk-r 5 7 n 7 mm m^r% i 

mm^yz^h, *<t>6WiH^ s#xhj-a 
mig*-5*.5fc«>££ i ©sssrttn i s#x h u-a 

A^tsi^ca^n, £i©®B«g**HJ-A io 
b#rb * * a t. * > -/ 1 l y x t mm zmn t 

mm^iommmxtit^^K^^ s*x 

s*x b v-mm<Du-%iizi\£-tittmt%ct 

ssi x*x h u -mrs ± 7 y * t 
nMLrcWzm^bv-mm^y^^t^o c 
7a7 7awt«7^>7x7-£]ft£ 
-rsft&ts 2 omKtEg&f&sfta&gttfc^o 20 
[ooio] mmmias^ztt, % \ <»mms% 
2 <7)[i]sgtDra$% k s&fft*$ i ©0s§rt£Di/xr m 

«->XrABf IHfcfflef* 7n 7 7S^<DfSi**T 
Htm**:/**:, eT*«€B#IHS4*S8llfT*RI 
HA^V^fcS^l/T^S. ^JglOSSSlie-r** 

« t*f* 7 -t ax 7 y -ficm t yTsT mmmmt 

7,Tmmt\£Tt$Ji>7,$y7°t(Dffi<Dt-(^yy 
x7-«st£t5^ i ZT*m* i 7y*tmmLfc% 

[0 0 11] *%Wt±, STi^y h^XV^-fA 

x7 y7wr s ertf-^ h u -A^ffes c t 

£«fc!J*>r5V?1tlfi£#*&;£a*^*, ^©7^ A 40 

7> £ u 5 tti $ ni/->"x 7 f*3 cfflf ? fts£$j& A 
x 7 y 7ff fs^-r /c&tcffl^ 5 ns 7 7 7**if/t So 

£fc, AX7>7°«er'*r-77 b U-Afr?>® 

a^ms % u , ^tacm^r 7 y »fi7 7 
1- s c t e j: o t *ra& * ^ a 7 * > Ttt « # u s>x 7 e 

5„ W&*-fA**X/1iffitfU^X2rtE#£ftSfc 50 
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?> H7^ ax 7 v^tteftfiiiBj&cjs^ lt^s n, * 

LT, ^©7^AX7y7 P «T-7Xh'J-AWcS£ 

nsc 

[0 0 12] ft©H«m±IBLfcJ;5{c, S#XHJ 

-AHf^ij^y^^ i6t"7 hcMSsnagfi*^ 

ty D ±ELfeJ:5fc, S*X h U-At3-7" 

rtt^t5n/t!g2S$xHj-Aa#ra*v->7^i 6 

L/c J: 5 HJfiEfHIBg** h U -At n-#£HBl 

* 5 saa^frv \ 7 -r a x 7 v 7 0 1- - 7 > nr^ 

5 ^SA^WS'J Ls ^^7^ AX 2 V 7 h - 9 y* H'r 

[0 0 14] ftiaitt^Xr Af Ifr^-r 

MPEG v'XtAX h U -AR^l^Blf t*t-# 
tZtDZhV-lifribOVlTtT-JLZZy-ftZm 

rABfra^-rs 1 Rfiaa ef*fa 

AX^y^«t5KT4-f3-^^7 7 

wm hi %i*s-r sj;5tS2BfFa*'7>7t jt«-r 

So S 1 OHBMc^rABfH (SY) , ^?^AX7> 
7° (TS) &tfg#*hy-AR#H (ET) ?:4^S^ 

VL-ZL, S*XhU-ASfF^ (ET) , 5^AX^>7 0 

(ts) my7,Tmrs (sy) 
rnmms (x) *#t, sx=et+ts-sy(cjs 
uTS2oinKt^siBf[a (x) m^-Dnmim 

*XhU-A^^A (ET2) ^£L, ^JHLfcHflH 
%J1^ 5 C t K J: -3 TKf Hx v-^S^ffi A^l^ h 
ioT, S2©@SSt^XrABfn^#tfeTSi:t 
SET2-XtjSCTSl©0SStt^2(D@Sgt 
HM3bfel^lHlct5!:i:tf"Pt«o 
[0015] SiODHKi:^20[5|KfcOHIoi^Hx7 

ftt>-6, Sl©0SSt^'l'AX^>7' (TS) StfSJSB 
flfH (I T) ^4^, Z4kX.ZV~t (TS) RtfSJHi 
BfH (IT) %ffl^se:i:fi-J:oT^BfH (X) m 

T, SX = TS-lCjSCTS2O0gSt^lfiBfri 



(9) 
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(X) *5*5fc#fcHfflLfcS#*hy-.WlSIHI (E 

t) m^u mLmm (x) «iv^tset-x 

H\ Jg2©@$KS/XriJ#K£ffi^T3;:t&<, g 

[0016] it, ®i(Dmt%2<Dmtmm 

§0 tftt)^, ffl©@E§£->Xr2JtB (SY) , l£ 
T*2'U±7>$yf (VTS) Rtflfr*a^lBI (V 
T) £4*. Hx'^I^BfK (VT) , kr'^^^AX 10 
?>7° (VTS) mis^^mm (SY) fc/H^Sil 
i:K<fcoTPSBI^HI (X) £f§T, SX = VT + VTS 

-s ykjsi:t^2O0SS^«fi (x) m^zt 
&ic%KDmm£Ttmm?3 (vd tin^Lfc 
i2o@McH'frtwi (v t 2) m^u m 

MLmm (X) £/MOi£VT2-X£]Si;T8#^ 
I7-^IS. lot, §H©0S§«, K5 2©0S&^> 

[0 0 17] *«flt*V^Ttt, 365U^7V>r3-^ 20 
7D7^(t ^7V>^fkRj^S^ (Hu f f ma 
n coded Variable Length C 
odes : V L C s ) RtfBSfiffiFS (Fixed L 
ength CodesiFLCs) fcH^ftU ft*T 
v^^n^n^ v7>ttlvi/y (Micropro 
g r a mm a ble state raach i ne :M 
SM) OW©7CT'h-^y^LTffi^U flft^LS 

[ooi8] mwmmimcts^zte, m^-y^ 
i m&mmmm&t zrztbw? *mm% 30 

t%>z.£*U%lct%o ^©£?&*l$f&$#©Wi:x 
X$--7W§{fcffi» (Escape-coded co 
efficients), h^DCfl (Intra 
-DC values) Mf^WbfW (Mo 
tion Vector delta) TSO, *tl6 
©^T&gr&LfcVLC/F L Cj&frfc LTX F IJ-A 40 

[0 0 19] V L CfcdrefM-afcJMJjtt* S±fuR 

5tfl*)ASn§o -feU^*ttR0MX*T?*OVLC 

A7J0g«J0 2 8lf'yF%tfi7JU ^tl?>©*#J©l 6 
If «y M±M7W^R0M3 0 2K#a&$tl5o 
£«<VLCfcJtLT-feU**H:C C * TffWfcSnfc 

e«y Y<Dmmmm^\:tc\-hmm^iy-7 ft 50 
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&7- Kfia, ffi^ts c §iM*^x 

(2 8£y F©MPEG-lxX^-7ft^{M) © 
Jg*fc, 1 6 e-y b-p&Sg;*;V L (D C 

»t-X;W 

[0 0 2 0] rr-TVWiKJ A7J«MPEGK<fc^T 
S#£na£4fcgftS^7VV^r-X;Mia03!fl 
Ofei&CfflV^nSo R0M«^U7£/~>7#T» 
Sn57FU^*WtT^5o ROMSVLCt-7*;!/ 
^IItS^TV\ ^ttt^Tr-^lf&ft (i nd 
ex-to-operation) tf8*§{tr-*££ 

[0 0 2 1] sS3ltf»l±s $Z.t>tlfcT-#1k±l&t% 

(don' t care)Jv^4tTirtS7 
Fl^£BJtMU (CAM) ©Uif^PSo 3BI&a 
fit (&L57;l/JUXAWt) r-7*;l/*3l QW77 
7 7") l5&T°ftt>nZ><DT\ m<DT~7)l*$mt5 

[0 0 2 2] *SSBK*^T, R0M(D7FUXJi2-O 

5*13^*^7 vy:RF*§£aft*So ^ftMPEGfiF 
^r-7*;Wdi[]x.T, R 0MttBf£«D«H§r-7*;WBE 
#ftfS^S=5:V L C^-y*WM-r*X**Wt 

[0 0 2 3] *58BBOfl!lO*8W«K*JV^T, T'ni'-S? 
* (MS) ^gT-*£7FW^£T3/ci5 

-)]/ KRtf 7 F UX 7 -r F£WT 5H£fi*Wf § 

U i^-^my •< FRtf 7 F UX 7 -r F£#f 
S 03317- F*WT« ^ t U £7 F lxXJt£T3 Xn 

[0 0 2 4] ^U^FUXltSTSXn^-i^ 

ib'PKt fcfc 1 H~-y h^I^7^-^FK^^57F 
U7v7^-;I/Ft^m/c@£fg7-F%lSSU r- 
^£D7FUX^ia^-r§^iS(©H , 7 FA^S«7KU^ 
7 -<-;!/ F L, n^gfir - * ©1M X fc ShtM b 
T 7 F 7 -f -;!/ F rt © t* 7 F ^ XS^kS Rl 
^fir-^ XKJ±«9LT(ilS£7 -r Frt©e 

Sfi7-K*fi8fr5-Sx fi«£7^-;l/Katf7 F 
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[0 0 2 5] **'J*7 Fl/XfflS-T 3 7n 
tt, Sfc, r-*©7FUX*R£-r5«»OU7hfr 

h£jjVT;fcfc£lfgS7^-;UF£ffll<\ 
7F^JI£tSH£B7-F*ftfif'r5-^ 7 FU 10 

x 7 y -;b fob ^s$7 >c -)V Y<omt itmzmtz 
[0026] ^mt^m, ttvftmmr- 
Fft^ftsy-FfcE-rs^ufctt*.* «Tffie»y h 

fJfiK7*-b^S-&Sfc»Kgp^7- FfcflUS^ 7 
^■bX L/c7- K»7- F t LT^2ft3«fc 5 
7- FOB 5 SP#*iKM U 7- F<£>8 <9 mzKtcm 
LTgB#7- K*<7cOffiBlcR«STf7- K*H«S* 
5CkKJ:oT<«|t5H-5ti*. 20 
[0 0 2 7] *|Sfitt, ^*U*7FU7j|£-rsSj£ 
RtfSB%#&, 7- F«RTI2lf r-**7 F UXJIS 

tsfefefcffl^sns^tHSey mmu fro* 

KS7-C - FRtf 7 F U77 -c F*£* S0£« 
T#S.5ft«. SK, T-*£7Fl^.fitrWci6t 

F&tf 7 F bX7 -c -;b F**ft § MS 7- F*rr 
5 ^ * U £7 F UXflSt § 7n 5/-i>+ tfjgv^ft 

[0 0 2 8] #589114, R AMADOR A M©jffi£0 30 

hfiN£ 9'>&l,i&M®7- F%7^-fe^f5 
£&T?fct>T, ^©R AM«R AMfr5©g:&ti}UK^tj : 
R AM^Olt&^S^WMg&tf^^ 

^nxttRAM^stJ&snaNoy-F^E^JU n 

<fc MS^M07- Ftf R AMfr5iS#tfiSnXfci:R A 
M^»f aStlTV^S t tfcftgiJU M(D7- F#R A 
Mfr£|g#tfJ£ftXttRAM^*£&£ftfcfctRAM 

[0 0 2 9]$5«, 2^0Wfit^jSbfc7'-^ 40 
7- F%E«LStfK*tH-rfeJ&K^^5 7^7^ 
A7^-bX^^V (DRAM) *7*-fe*f 3£&T?S 
oT, *ODRAMtt20©»ltLfe^y^*WU £ 
> < > * a r- * 7 - F £St* ffi-TR if* Z &ty*- 

- f mm s <: £ t , 2 mmw 2 wt 

#i) 7 K/<*-vott«Stn, *-b;W4H*OMX 
Nv h y *y ^x£#&, &-fe;bt#jSL/c7- Ftt/O 
*<Dl^ttT*i&6, *0*Stt, (a) Z(D^y 
5<D o %<D&fe<D 1 -D£itJ& Lfc±T<DT-# 7- Ffr 
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tfSt&StiS <fc 5 £&"fe;Mc 2 toXyWttaffifc 

(b) H*0vFyy**fr5*«-fe;^8CU 2# 
tc^U v FW-ytm£&-£#f, 2%7t?V v F 
; W - y ft £D-t;l/OIJ« t n/cr- £ 7- 

F*t**WU (c) 2^'J7F/^->rtOW 
^M^b€*nTi^^-b;l/^^jSb/ir-^7-F 
fc^&cfcfcitBIU (d) fflfi^fe-tfSftTVft^-tz 
;1^»J&L/ct-£7- F£#tr«fc 5 £lffiij£ftfc?y 
-y F^^->©*©-b;b©-7?^^JSf^r-^7-F 
^DRAMOSlO/^^i^I*ffiU (e) fifi£ 
*>£2nT^*iM*;l/fcmLfcT-*7-F£#«y«fc 

Bf*r-#7-F*DRAMOS2 0Ay^5ll* 

tau (f) fiB^^nT^^i^i/t^jSLfcf 

-^7-K^Tfil»tli«n5ST (e) Rtf (f) * 

[0 0 3 0]#8Ktf\ RAM'MD^XfcgSBrfSRA 
M^^-7i-XWU ^«7FU^^ffitt7 
FbX£fg±U R AM-fy£-7x-7.teRAM£7 
Kl/^fi£-rSfc»K:*aB-pa65o J t©7Fl/^«4S 
ti2H^y^-7x-7^/rLTRAM^y^-7x- 
Ztmm.tZo #PIK«7U-AX{47^-;UFt 
LT«!ia«nfc«F9ft:er*r-*0^'y 77 y 
KfflTf CO^!S(± ; &A^^b7b-i, 

[0 0 3 1] i^T, x^r-^^a^fb-rs^^rA 

©sit, mmmmtm%btcct^-D^r, mm 

fci6©&g%g< Has. #^0* ©fficgwatffij 
as # c t s n 5 ^opaiftKiKfr s hj^ *> fr 

[0 0 3 2] 

1 ) p^y 7 FU^ffl£fco^TO#%KOl3BIS:KJK 
H£*M7- Frt©nJgS7 y -;!/ F 
7F^7ll£^^§/cJ60Bl^fi7^-;VF^^/c 

7FUXB^ 

F*fiAfenJ|gfir-*07 Fl^XJIS 
^^nn- FfbRjtg^mivi/ySjg 
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3) mmmfc-o^Tvmmmmmm 

5 ) \?T*m<om£wT<D*mmw%fsm 
m 

F LC&tf F-*>' 

^Sfi 10 

7) IK§»t£fi 

com i *#B8bT^-ra*^ mmvm L^mm 

0fltt, *84&«&tfD ata y-tyZM?* zto* 
j7°7'{y : yzTi±*miT^5c ?o^tAc± 

SftSHfiX^-h=i-H«ffi8S2 0 1 i:, A77^f 
0 3Mv^^o7n^7?7«v» 

(MSM) 2 0 4*fi*&^£lfT*$MfflB2 0 2 4:, 20 
SStfPiMl'ffl* (IDCT) 2 0 5 t, 

- 7 h 2 0 7 £1* fe Hffl D R A M 3 > F P - 
52 0 6 £, 5ITO«2 0 8 ^ 
92 1 0, 2 1 lRtfert^^^yy^0ES2O8 
£#tyS^0SS2O9T*;&£c 

[0 0 3 3] #II&D iscovision Asso 
c i a t etioTl 9 9 4^3^2 4 0£ TVide 
o DecorapressionJ tlifflOM 
S^mM9 4 0 5 9 1 4. 4^KfcV>T^^n/-cSHSrt 

[0 0 3 4] ^tU7Fl/^mStdV>TO*^(D|¥ 

xmiK&zttvzT Fu^Jtsta^&RtfSii* 

t, ^%WaH£ffi7- F%fiB*.feTOBT-*%7 K*40 
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£#£Wc*6. XBB33S7- F^fl^/cWSr- 
*£7 K S u t £^T7- F<DW» 

«ifi»3 7*wr 5 v-r 703- Fftmt^mivv'y 

[0 0 3 5] v^un-FfM&mivi/Mi^ 

iBStrsfcfecfflv^ns. ^©£?&igfWJ«, 7F 

(1) 7-FO^£ti$#*7**;**5;fcJ&fc:Rr 
£S7Fb7, (2) 7FUXftffl^5 2'O<0fi&5 
#a«W«LLftntfftP.ft^. *^Efc^Ttt, 6 4 
X3 2t*-y FflUfrfc^tf 3 R AMB 6 4 x 3 2 t: 7 k 
1 2 8 X 1 6 V. 7 k 2 5 6 X 8 tf-y k 5 12X41? 
1 0 2 4 x 2 1£7 FX& 2 0 4 8 x 1 1: 7 FJM 

[0 0 3 6] ^H7- Fl^tDnr^#7^ -;b F 

£ < ©77U >r-y a >m B^, TOIr-27 F 
Xtt7- F©ffi0$#®E*W©»ft0fca 
}c (7-f-;H f i:l/Cftl5ft*'<*) 7-F©rM# 

7- Krt©7-f KOS*fS£f Silln 
©7- K£to*5 £ fcTfcSo *^B^THi7- FfiO'i 

«%^k-r5^s*a^5o 7-F 

fc , rT^B 7 FW O 7 - f TPS t n a s± 
feXtilTfe e 7 F £^t?& & if <: ©ft-^tfteS mm 

[0 0 3 7] &r>Ts aitt81fyb07-FrtK:£«) 
e>ftg'M^yFiH6Sft3nM7-r-^F ( l"Fj 

04-°r>^^;b7^-;l/F^fBLTl^o 
[0 0 3 8] 
[SI] 
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mfctzrctbic m (3 2 if 7 f) ©7-f»* 
?x5n?.o ^ti©7-Fa7^-b7>^n?.gp^7-F^ 

L S BtHSE^nSS^ffl^nSo 7-K©±tttffl' 

x^s©«/j&t L-cmmmvttmzv 

^iistst-Ffc^^T^So a^y-K^tucA 
^n»tM£ft/t£t, ^nmiSbfc^^7-F 

3&3 2tfy F7-F©£4©4lf>y F7~F£4tf7 
F©a5#7-K*77fcXf3Xrv7 , **LT^So 
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4 tf 7 F 7- F^©gP#7- F£7 7-feXX«K!#©5 
fei&E, £H©7-Ftt2?IJ©2 14©*5tLSBK 
BP^7-F%fi[jI?-&5fe«)ttlS?-&5^A^5o 
3yiJ©2 1 5E*Lfc<fc5E, 4 If 7 F7-FI4^ft 
3 2 If 7 F7-F*f|sDffl*fe»EB3B*tiSo d©7 
-Ff±E-5C7^-b^t5i:i:!b^tSo 

[0 0 5 4] 0 3E^L/c,£5t, »$M£ft5fc#) 
£, SJR2tl/c^i©7-F«, 2?iJ©2 1 4CSbfL 

7- FtaasnTv^s7c©sp^7- f©se« 
p.n§o l s B©fiBTent±4?ij©2 1 6t^^nr 

J E-©g«tbT©7-FttlS*®oyc7-F©fF 
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3. 5S£fc7-FKffi§iU ^LTtftfWKS&'fSo 

4. X*LfeaJ»7-K* (2) i^O«Uc^S 
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(15) 



27 



MI£££&7-F£B< 0 
[0 0 5 6] ±fE©77*X«H4K^b/c^l)<DT 
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t U O 3 2 If 7 F 7- K<D5!I7 F bX t bTitjgffl 

FbX« To b 0 0 0 0 0J (*ft5l47KU;*tfMS 
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xxxxJO->7K 0fr£>3 1 tf7 F'>7 

hfcttSCfctfTtS. llS^fg&lfATJV^T'b? 
im&4tftf]7-F£vX777FU »S4ttBEA 

WfcOfci&o 2 o©nJ^§7 ^ H<D«*tfcMfr fcfr 

[ 0 0 5 7 ] m 2 liTtto 2 JUICES fife J; 5 ic rM 30 
r-^®7 Hb*}|£RtfllgW)fcl&fc:@£(l7- H 1 
3 If 7 KOfi*OW*SLT^«. t+lOBHTftt, 8 If 
7 F7-F«{fi« robl lOlssssJ fc7FbX 

wzzn, cce, r s s s sj «ffi«7Fiyx«^e» 

FfbRrt^iM^^yott^tfc^Tfttff^fen^c 
^<d««, tua-m^tmsnmmmcD 40 
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[0 0 5 8] ##SHHE<fcftfcf, ttttv>»2 1 8&x^ 

D3- Ffi^O 'J X F fcft L TlffT § 1 OOiUMp 
bX«0 7fc^bfcJMT&3„ «^^n/tfIti0 6R 50 



fifgg¥8-l 7 2 6 2 4 
28 
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[0061] i^T, ZttbtLrXtDZTyfttt 
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[0 0 7 3] life 2lP^lt©2 0©±ft£}£tfEo 
ng Gi Lee ( TA NewAlgorithm 
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nd Signal Processing, Vo 
1. Assp 3 2, No 6, p 1243 
December 1 9 8 4) RtfW e n -H s i u n 40 
g Chen ( TA Fast Computatio 
nal Algorithm for the DC 
T : DCTffi©«jIltg7;PnUXAj Wen-Hs i 
ung Chen, C. Harrison Smi 
th, SCPralick, IEEE Trans 
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Col. Com 2 5, No. 9 1004, 
September 1 9 7 7) E±oTH38£ft 
fc„ KB (Eong Gi Lee) ©MHSDCT 
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3km^mm (recursive) 
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h e nOTSrSS^-F^xTKTfffta fcttttiPlHS 
&tff!S880^vl/;I/Bi^fil^.5J:i:*'-etS:v\ z. 
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fctfl#»L<, £»©7-*t7^+& 
C WStfifiOD C T£t£ 

? ©u-w b fcHff*"&*&Stfa^v7 b->x7ts 

6, ^©£ 5 ft73&«7V 5?*;H£r*fflTasn*3S 
fiW bTTOcfTft 5 fefetttjBI^ Xli¥»tt7 

[0 0 7 6] Ur*r-*tJ:»)DCTRtf I DC Ti!) 

^n&*wi©??i)/j^rt^s^g*-r § d 

^otWafifSi 2. 3 4. 5 6fc*iin*5<:i:Efc 

stfB£T& (1 oa/j^a ; ene)2o©^i©*3^ 
a\ 1 oi/j«(± mm Ta&5ci:ft^t«c ) ft 

3t£««g 16.86 fc^tfci&fcg**** 4 0©S^ 

<Dm\m')>iE*£z>mft\mt>fo\ «ts© r6] 

^fBS-r^il^tiD^C^^^fSJiTl 6. 8©g 
3ffi©3fiffiffll6. 9ST^©^*E 

[0077] *§Kffi*ftM*^ffc, mvmtm* 



(18) 
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5, ^o&^HttEAiiiBrcs*., h»eaxh:«o 

rafiffiAXiifl •? feT^M^inS J; u siiJf T-HSWt* 
t ^® T t£ r *fS^£M t § £S ^Somgfcg* 

[0 0 7 8] ifjaWftDCT/IDCT^ffi&tfA 

i ol/J^T\ MM^i^V^y^u-y;^ 

snaa\ '>fc<£fc**<a'>2fta 0 ±ibo^jt 
«\ 99. V9&*)±^mimt-znf, noat 

©1 0im6©£mi!f3f(c£<fBlP£4x.&i,\, £ 

fctfTfrSo 08*.& ^©^1 230 + 0456=16 
8 6tt, l"i 6 8 6J AD*© T6J T8J fcOlHfcl 

oi/j^sus^-ra^sattttiift^soT, i 20 

2. 3 0 + 4. 5 6 = 1 6. 8 6 tnW1&ZZ.tttM 

[0 0 7 9] £Sli:*nfeflUfiBO«*«6 , r 1 
*fttf, *57-*T^f-+ttDCTXttIDCTlW 

oflfio^Bt, & tf ijr b v & h mwmxti^(D 
mkk, mmmm^mmm^'TfrfrZo 40 

[0 0 8 0] r^o^^-^Hftj %*&a#7-*T* 

ArttfWT?taiig££&Sfc-ra. fi<a?.nfc < fc 
vhtf r 1 j *5a'»Mi«^o^is*tiipg? 

ft, gtfvbtf roj &5tf*5;£nft^J:5EftlJHB 
fttf 5/7 * ©ff %-»Wt^ty. -fl§ffli£©St1f H 
oH'-yht. r 1 j Tsa^fcias-racfctf-etftw- 
nar%^*v^©T?, irag^©?Mi¥7-F©&t:'y b 50 



!ffM¥8-l 7 2 6 2 4 
34 

[0 0 8 1] WfcbT, T-^7-W8e«ybteT, 
5£J;3#-A£*flirfafcE£Trao »5©8t?y 

Fggi&o 0 000101 -pfeSo svg^-rnn 5 

t <t a rV i^itjmAMftftt 2 b 2# 
(4KJ:*«llC»)S1-8) , ZLTZ<D7V7<s7Y 

0M<D6-?<DtflM& roj Ctf-ybffiSrWU ^tXT^ 
n&tt^7hXl±jiin©^T7 7'*^i:tftK 
[0 0 8 2] HSffiSoUSS, T&fc-SeKDS^ 5 
^t£«t55lS*-r5 C fctf Tta§Hi¥8B« u e 
•y bfcftSfc&E&Sfcleli&titeHffifcO 

ra. ffic, -isffli©^fft§f±8o©{u«©6ott^ 

roj £tt£taJn£$0fT*Ktretf Bfcits <: ktf 
t, *ftfc J: D f U 3 >Sf$£'>& < * § E k 

So 

[0 0 8 3] IDC TTftfefcfe^T, *5Sfit intl 
NxN®*7a-y^O : SNfT (row) &tfNJ!l (c o 
1 umn) «01*7Cl DCTttlHBI**tU l*7Cl 
DCT (1-D IDCTttN-2fflftOif3RX*7- 

5 0 ^SU^fiSMEfc'^m J PEGglftfcfSUT 
N = 8T*£5. 23tecIDCT«MB*tt2O01*7CI 
DCTHjff^ (T-^©*l©li*^Kt^^T) lit 

[0 0 8 4] 4±l©ffla7r-y7t^o^T, N=8©fc 

a 2 oc^k^^ Mit^js-r a 2 o©-s«ffi 

ilf©AWiat (pairwise) T*SPg2ftX 

[0 0 8 5] *lu4±MlMTa, IfefgfiQfftA* 
7-F«2<DTOStJ;^T^i6Sg?n, ^©ffSA 

fflROlSSfiOifJ?^ N / 2 BttfHftliflU&OilSlHi 

/ 2 raffias a sf ss((dss{i t moymm t mm 

[0 0 8 6] (er*«!Si^^rA03Sffl*Efe«-a) 

d c TRtf {wm<DM*mm<D 1 xtt^njjLt^e 
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E, *<0«ttffi*a2Jife5/7HCJ:5 2OH»K«fct> X«*fUeU:®$a£*if5 trtr-^C I D C T& 

^Sl-^o i. ^TOKfliftiWMB^oattKiffifflo 

[0 0 8 7] *f§H5(D^Stfcnj-3{ti©lttKfc^T 2. ID C T^STf Sfc&Cjftg&^'J 

-Fa rn ro] <D^tftMzwiRLk\£yh(D 7*7-ry«yi<orc46ESSsns<tt)^<*<, Mto© 

*©2*7^sii±sioi^7ci dct®hxt77^ io <D~mmmtmLK7v?(D£?frpmm 

[oo88] ^m<omnmcnm, i d c t ^ss)ft^i$i* 3 sit^ffl^3^s*^i^ a cb^ 

Sfft a* 7 - f o 7 7 u s/ 3 yw$%m%mc u 7 . » ^FW*^ur-* o?^n^$ijfp-r § 

[0 0 8 9] *5SaiC*S^TI4, fl»&t«f»OA*7 3o 

-F^Sb<a^-o5ag7n-y^%/M,r^gibfc [0091] mmm^m 

mm-mmitti% 0 A*r-^7-F^»Sb<a gb i DCT^x-fAtfflv^nsii^a^ 

g-eiifci^tf) , mt^iixKiT-a§<, trb5r soei^ftfli^iyRogw&rfa^fcttc^waflP© 

ure^yf-sna. it, HRWiaMf 30 B&ttfc&s,, 

ffll^Sdi:ft<, ffiOftia7*D7^ , r*SJ;5fc^O NxNi8lS7ny7©2^7:t-7-FSft3tM> 

77U^r-^3>}cffi5»tuD^-y701fSi:bTS^ E»©»^W^iltt^Olt)-e*5. CCT?, U (j, 

tmt. k) «H!S£&*ff|X (m, n) ICjtfRrmmmm 

[0090] -Kfflii<D (2-D<D^xiim^rz) m 

wmm^m^o trba, -mmwmmL [0092] 



ddTfs j,k=0.1...,N-1 



2 n tt^gi© d c b'Wfcjfcak ^fc c ( j ) , c SffliffcniM yg& ( I D C T) O^tt^Ol 0 

(k) «4»Efi{t7 7^-?;g>3o ^nfcftfStS so So 



_ «- AM 
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j l k=0,...,N-1 



■5, I D C T ttJii6SfI*£IM£11-gSl*fTfc 5 



x(m,n) 



[0094] ^2n^^^ymmtm\m^t 

ftfr 1 K/cittm LTV^S E k ^Sfoto S 2 tt*<D 

[0 0 9 5] 
[S3] 

zw J m L 



2N 



fcSS 1 © 1 &7E I D C T fct$flST?*5. 



★ 1 *7cONjSO I D C T (ClTii ttfflSO ttjfcoat 

[0 0 9 6] 
K43 



X (A) - E c(n| 



c (n) . i/(vS) 



/f - {0,1 AM) 



1 



ClT, y (n) ttjfi!gSii8»'N0NA^t?*!3, x 
(k) tt^ONffl^TSS. 2^7C<D«^©<fc5fC, D 

±ELfe±5t, 2$GtI DCTfco^TI4II***fc 
<fcoT#«Sft;fe 1 I D C TOi'-'Jri'Xfcffl^T 

7ciSt©0&<<?ti\ SSt^XRtf¥«f^l©Ii??: 40 

[0 0 9 7] ^»<DIE^ 
±iaU/c<t9C^ I DCT/N-F7x7©figftfSffg 

mi*. m^M^mm^mmmwpX'^ 

5o «fc^T, I DCT£fctt5DCT£ff-J¥-r5KfcA, 

¥Sffi®7 r * * t «t o rmmtifflmztiSo s 



tf\ I D C T gIM E 2 ioTl 

[0 0 9 8] $mm&ftl£. 1 I D C TiS 

Hilff tt«RW* 2 *7C I D C T ©!i»4$T3 £ 5 

5 © 1 ^StJll&ft©&>«? tilSI-O 2 ± r> T 

K, & 1 I D C TgfctSV^T 2 ©¥7Jffit£3±£ 
tcib, fO^rAttJ PEGXttMPEGJBftKJSi: 



(21) 
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-D<Dzmm<o^m^Lr i d c t¥*#7-* 

[0 0 9 9] WTKBIBKa^S ^teSSS 

t zmiE tx% {mm * r y t & 5 1. 

^3SSEttN/2ffiffitfl* (k = 0, 1, -, N/2- 
1) &tfN/2Sffitttij (k=N/2, k=N/2+ 10 
1, -, N) Kftmb-zmttZZt&T'tZo N=8 

(CO^Ttt, Cinttft-f, y (0) , y (1) , y * 



If Fwff 8- 1 7 2 6 2 4 
40 

(2) Rtfy o) *twrsfc»KA*%a«b, * 

LTy (4) , y (5) , y (6) RXfy (7) fctf* 

[0 10 0] ift&tti^ (k = N/2+l, -, N) Ofc 
fctfESk' = (N-l-k) *SALT*tt£«fc')k 
(N/2+1) A^NST'UktSi^k' tt (N 

/2-D a^NS-cgfc-rs. ^n&siME^© 

S5 (£If©Kl£S^TiSE^-iO &y'S6t^ 

[0 10 1] 

K5] 

r n(2fr-1)n ] 
2W J 



c(/i) • y(n) • cos 



k={0.1...,(N/2-1)};and 



[0 10 2] 



■ K6] 



c (k) . x (W-1-*"0 - |yC) (-D n cos [ n 



w d T\ k ={ N (NE+lfl-^O.I (N/2-1)} 



(±Xmm^c (n) =1T*S§©T'C (n) ttC 

(D^.mmai^mi\ ) 

S5RtfjS6«E, II (-1) ° tf±fitf)N2atiJ<re 
^SA^ (n o d d) <D^tf^cD7uT«0^^ 
A5Cfc*|»^T. JftyStfc (0) =l/2' /z 

[0 10 3] 1 I D C TPfflaKtfaftfflft^Oft 
M * 



c(2n)/(2n)oo S [^p]- g * (2n) / 



★ 1 #7U I D C Tg^S4 fcfctt* 1 CO^ftti 2-3©^ 
fHcSNBtSilfctfTfSo 20©£fH;i:«Uj (N 
= 8T*Jiy (0) , y (2) , y (4) Rtfy (6) ) 
K^tS^ff-fc, t^A^ (N=8?«y (1) , y 
(3) , y (5) RXfy (7) ) KftfS^ff-fcTfc 

g (k) amxii<Dmmmbu h (k) 

[0 10 4] 
K7] 



) cos [He^J 
2(|) 



[0 10 5] 
KB] 



k={0,1,..., (N/2-1)}; 



k=(0,1,...,(N/2-1)}. 

N=8T«S7&tf:£8£:teW-4MHiN = {0, 1, 
2, 3} KMoTfc5n5o ^dn-tj-^XDlH]-^ 
Bl^C-Tt, 2cosAcosB = cos (A + B) 
+ cos (A-B) T?$»3, A = n(2k+l)/2 
N , B = n ( 2 k + 1 ) (2N+ 1) /2N£f£5£* 



fSl¥8-l 7 2 6 2 4 
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2cosA=l/{2cos [n ( 2 k + 1 ) / 2 
N] } =Ck 

tc^fiw mm) ntimmmvoy?. m 

^rtTl&frTCfctfTtSo y (-1) =0fcV>5S 
«£M£U A*y (7) icfl-TSniMVBIStfOfc: 
«U\ h (k) a^OSK*t«^.5<:i:^t5o 

[0 10 6] 

K9] 



ft (k) . 



k=(0,1 (N/2-1)}. 



Xt\ [y (2n+l) =y (2n-l) ] tt, h (k) 
OfWKfeV^TfflRWjStfN/ZOSOAAp (n) 
= [y (2n+l) =y (Zn-1) ] «KlSt*fc»* 
n p (n) 

0 y (-1) +Y (1) 

1 y (1) +y (3) 

2 y (3) +y (5) 

3 y (5) +y (7) 
h (k) ©39tt#©±5fcato-Ti:i:tf-eS*. 

[0 10 7] 

Kio] 

/.W-PrE p(n)c OS [i^] 
^ 2 (^) 



k=(0.l (N/2-1)}. 

£fffiH§©7cT?niM GS 5 fcit^T) l #tg I 
DCTOflti&fc&^tSg (k) Stfh (k) <DPu^ 

5, TSSpg-rftfcSh (k) E«-rSIDCTOlS*tt 

Ck=l/ (2cos [n (2k+l) /2N 

[0 10 8] fl^ntf, g (k) ttfflSWjy (2 
n) -eiSlg:il^1-5n/2-^>HDCTTf*5, 



20 p (n) Ofi«&0J:5fc:*5. 



= Y (1) Y (-1) =0 £8fcJ;D 



h (k) t± [y (2n+l) =y (2n-l) ] ?«* 
Hmn/2-^yHDCT?SD, CCT, £ 

iu?Ty (-D =ot?*s. *En-*^-ro 

y n = y (n) ; 

c i = c o s (ns) ; 

c2 = cos (2n8)=cos (114) = 1 V" 2 I 
c 3 = c o s (3n8) ; 
d 1 = 1 [2 c o s (n 1 6 1 0) ] 
d 3= 1 [2 c o s (3n/16)] 
d 5= 1 [2 c o s (5n/l 6) ] 
d 7= 1 [2 c o s (9 7n/l 6) ] 

c 1 s= GT2) c o s (n/8) ; 
c 3 s= G/~2) cos on8) ; 

3*>ryHao^-tt (cos (-♦) =c os 
(0) ) RtfJiltt (c o s (-0) ) n (-0) =- 

cos (0) fcfflV^T* 37&tfj£8ttN=8£»LT 

sm-rscfctf-eta ( (o) ttiV"2T?»s. ) 



(23) WF8- 1 7 2 6 2 4 

43 44 
g<Q)-l/-/"2yD +y2c]+y4c2+y6c3=iy^(y +y2cls+y4+y6c3s) 
g(l)-i/</"2yO + y 2c3-y4c2-y6cl = (yD+y2c3s-y4-y6cls)+y6cls) 
g(3)-l/VTyO -y2cl+y4e2-y6cS = l/-/T(yO-y2cls+y4-y6c3s) 

h (0) -dl {y 1+ (yl+y 3) el + (y3+y 5) c2+ (y 5+y7) c3} - 
diy yTZ\ V r 2yl+(yl+y3)cls+(y3+y5)+(y5+y7)c3s) 
h(l)-d3{yl+(yl+y3)c3-(y3+y5)c2+(y5+y7)el}- d3A/~2\ 

{</2yl+(yl+y3)c3s-(y3+y5)-(y5+y7)cls} 

h(2)-d5 {yl+y3)c3-(y3+y5)c2+(y5+y7)cl} - d5/v^". 

{-/2"yl-(yl+y3)c3ys-(y3+y5)-(y5+y7)cls} 

h(3)-d7 {yl-(yl+y3)cl+(y3+y5)c2-(y5+y7')c3)-d7/ *J~T 

[J 7 !? 1- (y l+y3) c 1 s+ (y3+y5)-(y5+y7) c3s} 

[0109] ^l©L(Dilitatiil ±T<offitt * g<o)- yO + y2 • cls + y4 +y6 • c3s 
DCTRtfi DCTffiSi&ft0ffi#£o^T2<£>7 7* g(l)- yO + y2 ♦c3s-y4-y6» c3s 

HKirj-ZlMOtStiio t^JJWffttf, *<z>^SS (2). y o - y2 • c3s - y4 +y6 • els 

g (k) Stfh (k) ©M^Pfi7r^ _ „ . cls + y4 _ y6 . c 3s 

*t±oT«W*n*OT?*«. iot, ^<Dg (k) 20 KW 
Rtfh (k) ©SUM?©* 5 £4*. 

[0110] [0111] 

Hii] * Kiz] 

h(0) • dlD/T ♦ yl+(yl+y3> -cls +(y3+y5) + (y5+y7) • c3s] 
h(l) • d8[-/2~ • yl+(yl+y3) *c3s -(y3+y5) - (y5+y7) • cls] 
h(2) • d5D/T' yl-(yl+yS) • c3s -<y3+y5> + (y5+y7) • cls] 
h(3) • d7[^2" • yl-(yl+y8) 'Cls +(y3+y5) - <y5+y7) • c3s] 



c2 = cos (n/4) = 1/^2T*&£©T\ J~2K 

&%ffluim&\skc2W= i z<Dmm 

1t&tfc3s%l»St5c:i:*^t5o cnttlDCT 
OT&fWWttO^Sltfc^TttfrrS^-- F7x7 

[0 112] g (k) RXfh (k) QHffiClSllSWA 

[0 113] 
Kl 3] 

1 cTs 1 c3s 
1 c3s -1 -cls 

Q. - 

1 -c3s -1 cfs 
1 -cls 1 -c3s 



[0 114] 



«(0) 




yO 


/U) 




Y2 




- £ • 


yA 






y6 



[0 115] 
[Si 5] 

a(0)1 ft ' y J 

hC3)| J* + ? 7 

ll-P, D = diag [dl, d 3, d 5, d 7] =ft 
ftfiCffio d 1 , d 3 , d 5 Rtf d 7 £HKfrO{ti!© 

SI 4fttfiU 5K^t<kdt, g (k) *3Sfcftfc 

50 K.mxtn?wifttz7ui/-*M t(i3t^y®-7 
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h (k) mzrcMzxmfcf csat* 

5y= (-1) WtftfJLT) ftTtetf-L&ttftfcffce 

y= (i) iz2ic&?T¥ibmnzft-&imtf% 

[0 116] Sfc, ±iabfcj;at, ^©N-*-Y> 
k 1 I D C T (S4 £#HS) t± (^;b-7°fb^n 

fc) N/2ffastfN/2fflax*«iKo^T (^ms 

*f©7ET) «a®37SlflF%^#tf2O0N/2-# 10 

^yk l^iDCTt^m-scfctfTta. ±13 
©Siiaco^MiJKfc^Tlll^tiSJ;^ £ I D C T 

ffififfift (N=8, thftk {0, 1, 2, 3} ) : 
[0 117] 
Kl 6] 

y (k) =g (k) +h (k) 

Kftffift (N=8, ffiftk {4, 5, 6, 7} ) : 
[0 118] 

K17] 20 
y (k) =y (N-I-k' ) =& <k' ) -h (k' ) 

g (k) mmmm^t^tcmwix-hmm. 

ifUH&ttU h (k' ) ttfidl, d3, d5Rtfd7 

5c lactate i DCTiHissoi§if^a^x?ra 

■y 7°±E iMn©x«H& I- 13t&fS7£#t? c £ E J; § 
©*M:£A£<X&HE}ti$ELTL£5o Sfe, I 30 

[0 119] TFSIft©^ 

^T©ffgOPSD^V^tt&tfE5tlt> *©±, M 

oetigiRtms^ nsfciss-rs i d c ts^d 

[0 12 0] L^LftA^, MbM^fc^E, 40 
I D C TyXrA(iHPg«{iSf£iiM*£ (C C I T 
T) Kit)T TCC I TTttftH. 2 6 1 -l^SUEfil 

f±a©^ i j * LTffl^nfcfiPwirfrafcjsuTSft 

tri 0 000flO8x8O7'n')>^*ffifjS-r«. 
©7*P 7 7tt 1 0 0 0 Oft© 8 X 8 © mm I D C T 

t (^iss^n/iHjtEA, tvvvysfmm® 
mm^x&zmm^T) d c tm i d c rmm 
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[0 12 1] lLCT<D9ffiimmZH.ikZ. *<DC 
C I TT©rXh7*n7 7^A*i:bTfflV^n§o % 
RE I D C Tg&Lfcttiftfct&fc]© rgtpj I D C Ttti 
ftr-*fc&ff«EJfc8<*n3. lAffi^ft^LTR 

TOffi© 3 ?^!©^*^© I D C TEft LT#££ 
ft3„ IE> to I DCT«ftjETSAft7*P7*tf£ 
T 0 £SA/^54 h tf\ £T 0 tfJftfc&SLfcfrntf 
Sfc* t©I DCni£T©Aftr-#©ft 

g< tik tine im-<om tsttiitimz 

t£h\ IDCTO^ffii. «A©l^TXh*E#£ 

[0122] m'J&<»m\± ( rs x 8©«gc3^ 

y&ft©^fr©fc«>© I E E El'IftlU , P 1 1 8 
0/D 2, 1 9 9 0^7£l 8B) Rtf ( r8X8©« 
f&3+K>» , I S0SM£©CD 1 1 1 7 2-2 

momh) icmzmnm^g u eee) © 

t>©-?&3„ *.ft5tt±IB©CC I TT©WPfc*Jtfi 

[0 12 3] A-K^lTOtl 
H9«*^©-m^JEcfc5.I D C T£)£©t-£© 

f8J:5 E, a- K*x7©ttS{iSfc/hST«MsKl£ 
o H9E$5V^Ts Y [0] RtSY [4] «g© 
v/Xri/vDAft&tfX [3] RtfX [6] |C'>Xf 

0 9 ©#S©&*r te^AftRtf ftft iMt5%t£M 
frE£<©tfy h-f1I©JAV>r-^7- F%{e1T§t 
-*^X©ff^iK ©£*{#£^LTl^ d taffi-r 

[0 12 4] H9EJ3V>T, At£R2 2 5Rtf 2 2 6 

a 2 Aftinssfc* u Mnst5©Aft©m6©^ 
2 2 7 ti^jsraA*7- Fosas^fflv^ns 

ct^LTl^o tOJSfcffiRfcfcSAftfcfiM-ft 
iwJIS&Hu ^f&©Aft^ffiS£^fcAft«r-f 
m& ±^©inll8&fr5©ajftT0BY [o] 
+ Y [4] EHb<^§^nHt, tti^TlOiuSStt 
ffiY+ (-1) , * Y4 = Y0-Y4*Jgj*f5 o *t) 
T, loffiS^ti.ATJ^IA/cingtKiM^ta^ 

[o 1 2 5] tfe, H9Efcv^T, -mmmiiT- 

*aBCaDO^LOHft®2 3 OEioT^^tlT^ 
«iL(f, Aft Y lttB0*4fiKfSinacSSEAftt 
5t5E, 2©TOI©Sfft5%lJif5o ioT, cfH 
€T3=Y2 T3 = Y2cls + Y6 c 3 sRtftf 
PlffiB2 = pl c3s-p3 cls=(Yl+Y 
3) c 3 s - (Y5 + Y7) c 1 st'$5 0 ZV^Ltc 

m. mmmzm o^t\M *Ltmmt g 

(0) ~g (3) ©fci&fcS 1 lfttfh (0) ~h 
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(3) OfefttSl 2*£frr5Cfc*W5. 

[0 12 6] H9tt*fSfl©SBftfc[j5*^bT^*o 

ttfcftofcArtp (k) ^«b20TOStJ; 
nTXtl y (1) *S»f5*ltt^Gi7ny^PREC 
(2 3 1) , Si 2 0<fc5£-£&»d 1, d3, d 
5 , d 7 O 4 03t3?f§£#t?jg 1 Wlftffl7"P 7 * P 0 
STC1 (2 3-3) , Si 6RtfSl 7©*5Effiffiffi 

jfiffl^ffltLTgO~g3SfchO~h3StOM^4 
^tli^2*tIftl7"D7^P0STC 2 (2 3 5), 
Rtf ^S&tfffl8r-*!i&£#Sn5£jI7n 7 ? C 
BLK (2 3 2) £4MWSnTV>*. 

[0 12 7] ^»iJtJ3tt^tt^7jaSyrVi>^;Wi 

iS&mm s fc a t a , r+ + u e 7 h j «#-f « c 

fc^ftttfcftSo ffi*&0!lfcLT, 1 + 1=0©J;? 

i^SH r 1 0 j (+18 r 2 j ©2I8S/+O 
aftuf, 01 + 01 = 00 (*+u4Lo^tf) +1 

FJ fctax.TIEUMHlgOO+1 0=1 O^lf^o 
[0 12 8] 1 Omm&ltLT, & T4 3 6J t T8 

25] fcfctajrrsfcfcrtSo ^-C2o<aSfc!jnrr 

1. loffi: r 6 j t r 5 j toipstt+offlc ru 
o+tUfctts r 1 j T'&§ 0 

£tt: 1, : 0, +VJ77 F : 1 

2. +©{£: r 3 j T2j tmmz rsj -ea&o, 

tuXr7 7°A^©+^U r 1 j fcJqgLT*+ 1 J*< 

r 6 j 

[0 12 9] 

£ff : 5, *+U^V : 1 , ^D77F : 0 

3. r 4 j i: r 8 j toipga+cDfit r 1 j 

0*+U*#t5 T2J fu*T77>?><D^ 
2, +^U^> : 0, ++U77F : 1 

4. +©{fi: roj t roj fcoingtwoffifrS©* 
+ y r 1 j zhmLT r 1 j ^4x.§ 0 

[0 13 0] 

£ff : 0, +-vUY>: 1, *+'J77F : 0 
0g© r 1 2 6 1 J ttRgOffiffiOffilO*-*' U 77 F 

*+yi'vttfirK:0T?&3o ) Mm, Pp«+©{ufr?> 
T8] k*ioJSt5J:i:*«fO«aitfa&5ci:t»a55. 
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a<ft*. 

[0131] ftSOStf-fc LT r++ U (car 
r y-s a v e) J tf&5nTV»5o &ffi©2O08<D 
£ft(±^£ffX«3SJl7- F (clOffBlfttO 2 5 1) 
RtfSftS^-K (10 10) T4t'Ji*Elt^ 

^©^ttRtf*+U7-F* r^i?f5 (r e s 0 1 v 
i n g) J ilttiotO 251 + 1010=1261 

7- FfcgfcHg&KiniltS C fctf TftSfrSfrWJgiJ 

[0132] ^o»§ii^tt^tf-irgt?sssn5^M 
7 7 T'a *<dw&h xk m % \mm^wmitv 
j:ot, +^'j-b-7m#5a^fTt'j7 7°;w 
tfeii^TftinJlofcfto*^ u 7- FttEliSftSfr* 

fefeic, «*»^ttRtfa»*+ y 7- Fa 7 7> 

[0 13 3] *^©il©||)i^tfe^T, 
^Iltt^It^l^C U, I D C T @K©Mt^^t|llP 

- HO** e 7 F PrX F * -b v F K «fe S* 

%hj^©xx hmw<Dmfmm^m-3< 1 d c T©ea 
[0 1 3 4] m 1 o«*i«fff L^»ooffij5)c^ 

BLK (2 3 2) tfcV^T^HIffia^nSo c:©A*t± 
£55^£®Wg£j!yi24a5o 01 Otfc^T, 
Y [1, 0] , Y [5, 4] , Y [3, 2] RtfY 
[7, 6j»fflRX*Yl, Y3, Y5, Y7AWft 
gUISS^^ClJiL, «A^Y0, Y2, Y4, Y 

W+KiJWr?)cl:5t, TMl (downstream) 
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iS(upstream) 'v^frStlS tm KffftS 

[0 13 5] I^Sc, IB^X [0, 7] , X [1, 
6] , X [3, 4] RUX [2, 5] {iffifflHtflXO, 
XI, X2, X3ft%-ftfi*StU ^ntiffeffi^x 
4, X5, X6, X7tfl<L^itft»^n 10 
5 0 09Rtf01 Ot^lTJ;?^ WUJ^YI, Y 
3, Y5, Y7-C*5fcJbj&£«£^tf, A*tt^£fc 

7^J x-^lSg^^Bj^tL, ->'J3>¥«M 

[o 1 3 6] 01 ot^u/iiat, mmxsm% 
a r+j (ipjfs) 235, i ocmwjfcfc-f sin 
ISH (Mlf§§) 2 3 6X«r±j (in^Stfitff 20 
237 mmvmzzctftxzzwmw-gs/WM 

7 b ©A* 7- F©£17n y£2 3 2 fcfett5*SS# 

ojp»»Rtf«ji«i4, m/mwv** u e v b*is- 

ttmtf y bXfim- 1 Ify b fcM^JLTSUfcLT^i; 
5meyh©as»-p**. f^g|**ftH «17ny 
* C B L K 2 3 2 Kfetfall 1 ©Sg&l/igm^ * 

+ u tf 7 h ©ipSA^coaiags TiiE^na t ^ -5 * 

+ U -t-7lP»tl/iES?5*^<DlSmt + ^ U e 7 b 7 30 

- K©g*S0irag£?Tfc5&gtf&i/> fc^S c txh 

[0 1 3 7] HI Ott*%MO»SU^^]Sfi0«tfett5 
lSt?2A*©7y^<Dffiffl*^UT^S. 01 Ofcfe 
^X, 7V?imJ5B2 3 8 fcl/T^Jftffc!), *ff| 
ft!7'n 7 7 P R E C 2 3 1 &tf|tf££iI7 , n 7 7 P 
OSTC 2 3 3©W££ffl^5ft3„ lA^Ovvf- 
tt^-yf-g [0, 7] , g [1, 6] , g [3, 4] K 
tfg [2, 5] £h [0, 7] , h [1, 6] , h 40 
[3, 4] &tfh [2, 5] fr5©£Htfjfc*tJS"rStt 
JU/feg (k) Rtfh (k) Tf**««talH8/WHS 
'\©A7:*7 7f 1 f Skftt, SgggDl. D3, D5 

[0 1 3 8] ±KLfeJ:$fc, «A*Y0, Y 2 , Y 
4&l/Y6tt£17'P77CBLKK 2 3 2C*V>T 
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A7J Y 1 2 ttjigjftA£ffitfftjI7n 7 7 C B L K 2 

cjT3ii¥*n*Jtntf*5*^o *Iu«17p77pr 

EC 2 3 1 fcfc&AWOTt 2A*SH ( TMUXj ) 
77fC10, C5 4, C3 2StfC7 6*W-TSo 2 
A*MUX^7^©lA*«^©$£ll£LT*ffi9© 

X, JEL^MOXlWV&VkftZ, ZtlhZ-DtDKfl 
F^©^fi{b7 7^©^*^«D^^CJ;^Tiil7n7 
7CBLK 2 3 2E§a£3XS«:fcA^t5o 
[0 1 3 9] 01 0ESTJ:5£» 2 ©WfSOSteis 
Dl, D3, D5, D7f±ffSL<f± j en&Offi**£ 

r^^^ts^mt^^^u/w~mm^o^x^ 

So 

[0 1 4 0] *^E«k5ftii7 > ay*CBLK 2 3 
2©0$U^MJ«\ Y [1, 0] RtfY [5, 4] 

0£#£y o *n5*?tt2ooA**^7Wl'ffl*i:L 

Pl^ 10©A7J©2©ffili£fc-Dfcf£) o 

k*j^t, i ocDA^a^nA^offlsgT'ipe^ns 

[0141] c©&ffi«7;i/X7--/i/©M^/fSS^ 

^^n^^OH^-Ptti^Sfc L*V^T±7?0 2'00 
© riB^S (combiners) J afagSSRtfSS 

mtbxmifb, zftt>m^(Qrcisbicm : TZ-$z>zttf 

Tt, ^©AnW©/i&©lg?^©*&3*tt£LTX« 
[0 14 2] ^OJ;5ft»g^8gO<Effltt, fta7D77 

c b l k 232 \zm^Mmwsmmt^ 

Offl*^-OS%^TWL, JS^©2 0©r-^llfS 
ic * S * y 'J -b - 7iraggs/Mgg5© tBTJ f: -St § c 
fcfic«LT^« 0 ^n5.tt ; e©2 0©r-^lK-e±tl 

7p 7 7 c b l k mznm < iwsinss&tfHgs 

-\©A7J^4fi!c-r§„ 

[0 14 3] ±tELfcJ:5K, «A*i±*f§H^©ffS 

8cA*A^fffla*n5fct5o tawsss (010 

KH^rf) ttSf»A*7- K*«tuftl7D 7 7 P R 
E C ^Offl p 0 ~ p 3 (09 p 

(n) <D%m zmmzzmyvrc 10, c 5 4, 

C 3 2 , C 7 6 (Dim A* (0 1 0 MflT 
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§ 0 77f lh0, lhl, 1 h 3Rtfl h 

HO, HI, H3MH2^77f«fti!itgttK 

[0 14 4] ^©tS«0^4*M£jI7'U7^PR 
EC 2 3lrtO2AMl77fC10, C54, C 

32, c 7 6 ©±ij a* ?77f uaa? u muj 7 

-Kfc^ft^y^fcftl&TS. «A£«g0~g3 
£&£il7n y ? P 0 S T C 2 3 3fi©77fLgO 

~L g 3^g (k) ffl^iattttsfefttfflwra. io 
[o 1 4 5] g (k) atfh (k) mmy^n^, 

t , *f£&l7"n 7fP0STC 233 tt^»inS38 
X7, X6, X5RtfX4*ai*-rS. fiffiffi^ffl^X 

3, X2, ximxoimmuw^/mmtam 

[0 14 6] *^K«fc5»$L^»b0^fTfiHl 

0 LTSS tu H9fc**ftfe# 

7"D7^CBLK 2 3 2 fcfettaiinJSffi, MUflRtf 

SJH8 oftfi^K ffilWS ft, 5 -iogg§/$ff3§© 

1 tt*»KO|iai0!|C<fc3 I D C T@B®£IS0±JS# 

■/a «/ *0BP R E C 23 1, #il7a 7 ^IHS&C B 
L K 2 3 2, &tf3ffc&iI7"D 7 0 S T C 

7\ &y$iJWl^^*ffitta7"n 7 7 @SS P R E C 2 
3 1 Rtf»a«il/D 7 ? 08& P 0 S T C 2 3 3 til 30 
gXiiai(W5nyha-7CNTL 24 1 

[0 14 7] WiMSU^Mflt^m A* 
RtfW*^ (Y0~Y7StfX0~X7) 14 2 2 If v 

hits § o cfttfsstsiii^fc^Taassft 
t«<t5C cog/J^tt r i j xtt roj -e&^t 

gftSftfciS&gS&^OfcS** U 7- K«r3»fid-r* C 

* 7 - F ©pfitffl S 1 5 <: o e 7 bSmii» A* 
T*hr-*©IDCTSSI*JBl#\fcafc, IDCTi/ 
Xf AtD^OlMW^WS^il LTtT&frft£o 

$ § e 7 f *m£ffit^j-r s^ticiot, rajtsA 

tfiftfr*)* fntiot I DCTS/^rAfrBOSIBffl 
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[0 14 8] Jt£«Bi«ft«^T0 4O0X*tt8 80 
/<7WHfl: (4X2 2) ^bT*fytta7 , n7^P 

*A^©H^,t 1 tatssssns. j;nsf, 

A7JT-^7- F«»S L < tt 1 O© 2 2 e 7 h A7J^ 
X*ftLTE9Jfc£TllKt*tU &A7J7-F&T-* 
IBrtoafflftTJjsK-f > F Tilt 77f2M„ 11 
HCasLfeiSfc, 2 2t*7b©A73r-^^Xti:T_ 
IN [21 : 0] 2 4 2T*^2ftTI/^ 0 
[0 14 9] ^©Elfcfc^T, WTtlMBai" 3<fc5£, 

>©£©«T& (LSB) *^-r*^7^rvHc^«n 
5. A73fl^T_I N [2 1 : 0] 2 4 2140 

frf> 2 1 If-y F*#f 3 2 2 £y KIT? 

fe 0 #-©E~7 H4¥75?7^7 hFW-#^LT 
£«£ft, T_IN [1] «{f^T_I NOftTfiU'7 
F©^©£7 h*^to 

[0150] *^o*asfi!itfe^Ttt, ywmm 

tt*MS17 n 7^PREC 231 ©Ki^*fflffll-r 5 

IN_CLK, 0UT_CLK : *58WKJ:h(f, ^© 
^fiBJfS L < »£& Dp7l 2 ^©{ifg 

[0 151] LATCH10, LATCH54, LAT 
CH32, LATCH76 :ffSL<tt, 10©22t: 

©A7J7-FMJI2ft3iufc^©7-*T77^rt-e 

jimiMi:-7 7f-$n*^nif^e.*^o ^ft&©7 

7 7 t fI^4#A7^7 7 t *ff»j2tf3fc&fc^6ft 

3o m*j4, L A T c H 5 4 urn 'XMm y 5 £ 
7 7fU ^©fg, *©fiiasoHrcitA*t#Y 5 

(0 1 0 mm) t n-^mmfa -^prec 

2 3 1 izXtltZXtlimY iZyvl-tZfctotRl 

[0152] latch: 4 -D(omxmmkMm 

A^Htu«l7*n7^PREC Z3 lfc7ff-*n« 
t , KL<tt77 ^O^OftOJU^ CBf jSt?5/7 F 
?n§„ 1^ L A T C H a*Wftii7 n 7 ^ P R E C 
2 3 1 ioTMSKff^na 4O0A7J 

[0153] SEL_BYP, S E L_P : II 1 0 
Stl5*5K» 77fC10, C5 4, C3 2StfC7 
6 (c 5 7 ^*n«fl«WJ3fll^fcHiPlRBStf 2 ©¥7J*g 
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¥75rffic<fctjTsi^nsje®^*5. mms e l 

C 2 3 1 ©t±i*7 7 ^«{f ^ll^tf 
[0 15 4] ±KLfcJ;5t, l$ft#II£A*ft^£ 
SA#tfft1\ ¥Mtt!7"n 7 ^?>-7^ LTffifS 

[0155] WSffl8lilK«£&ftiI7a 7 7 P 0 S T 

C 2 3 3 (DtztbtCM 5 yWMSif^t 

E N_B H, EN_GH :09 4Bg#fia-TSi:, ftl 
7Py*CBLK_2 3 2fr5©tMjtt, tFSA^fcffl 
ILftl, HO, HI, H3StfH2i:UT^$n3o 
*ft5©E*H:a#J©£!7n 7 ^ C B L K 1 232 
rtOffiSSRJfiBd 1 , d 3, d 7, d 5&4Ei£tiJ2ft 

ft, h 0~h 3t%fS&1^77^£ftS)£tf3 t&t 
g 0~g 3fi«fiBft55yf-*ft»«-e:afc«)Kfflli^ 
etx3„ 

[0 1 56] ADD, SUB : 01 Ofc^WcfcSK:, 

atfh (k) mmz'Mmuwgs/mnm i-o<da 

ytrtttSo fl^ ADD, SUB ^(D'MUm^/M 
EN_0 : <l(Df^tt^ilPg[S/SSS!b^©^% 

v 7 ^-r 5 m =7 7 ^fcfti&s ^3 Tcibizm^n^o 

[0 1 57] MUX_0UT7 0, MUX_OUT6 
1, MUX_OUT4 3, MUX_0UT5 2 

t, lo^tuwa (xo~x7) ^tt^-iSEtcstti^n 

3„ ^ft5©{f^;H^©7 7^2ftfctti7jffiCDt£t© 
tilt) 7 7 5 1 K 7 7 ^2 ft 3 ^ 1 1 © *Sftf 5 fcl&KJI 
CftfflSnSo i^T, ^ftP>©{f^&4-l v;l/^7° 

[0 15 8] T_0UT [2 1 : 0] : £ft£W±}g 
7*P7^P0STC 2 3 3fr5>©2 2 If 7 F©€^£ 

*fu£!7'n 7 * P R E C 2 3 1 5> ©trjTJt^fcW 
II 7* n 77CBLK 
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2 3 2-\©A^ff^*4fiSc^€3/ci6t779 L ^n§o 

01 lfcSSfifcJSfc, *lu«l7*P7^PREC 

2 3 lft»BOffl*fi#tt4"Q©2 2tfy h0T-*7- 
FC I 10 [2 1 : 0] , C I 5 4 [2 1 : 0] , CI 

3 2 [2 1 : 0] , C I 7 6 [2 1 : 0] i:LT4A£> 

tu znimwfv 7 ? c b l k 232 ^©a^a^ 

IN [0] , IN [1] , IN [3] , IN [2] fcft 

[0 1 5 9] 01 lEjF?\fc5E, ftI^n>^CBL 
10 K 2 3 2A^04O02 2lf«y KD|g*l±tti*M#0 
UT0 [21:0], OUT 1 [21:0], 0UT3 
[2 1 : 0] , OUT 2 [2 1 : 0] fcLTM#IEg& 
£ft?>„ ftllt CO70[2i:l],CO6l[2 
i:i], C04 3 [21:1], C0 5 2 [21: 
1] ^LTHtiftfi7a7^P0STC 2 3 3©A* 

[0 16 0] £iI7P>y*CBLK©fc«>£g*£ft3 
Sfflft^ii^^o £©$J© I D CT->XrA©a--^ 

©) Kiram *fu£l7"P7^PREC 2 3 1 R 
tf«£#17n 7 ^ P 0 S T C 2 3 3 * n y $\ * 

[0 1 6 1] 01 2«*^(C^t§*M«l7"n7^ 

PREC 2 3 lO^ny^HTSSo u©0Sti : ^n 
30 KfKHtfc^T, !E*f rs 1 [a] , S2 [b] , 
-, SM [Z] J ttfl^Sl, S2, -, 

r a ] Tfe5S±fiEeyh (msb) syfi^sMos 
s?eyh r z j ■cfcsgTffievF (lsb) tftt^ 

S«ffl&©#*fg^ a, b, -. ztt^O 
AXflg©$eHrt©8lfre£3o ^©11^7 H»© 

h7-KttflSO#-lfy Kbits),*^ 
40 tt££&Xti:S5#W&£ae 7 F 7- F i:«£BfflSft 

[0 16 2] $m£, 0 1 2EfcVT\ 2 ©¥£«©!! 
IHgtt R 2 MU L ©#P < ^£ft3 0 C 0*^SSffi^ 
Stii^^nS r-b-7" (save)jXtt r*##-&ff 

(unresolved s um) J it 2 1 Vf 7 F7~ 
FM5S [2 0 : 0] tlT^itl, ^«E, mm 
ZMMLh^mUftfc T^-vUJ «2 2t*7F07- 
KM5C [2 0 : 0] tLxmtis *ntt*+U-fe- 
50 7*^IWijngflM5A© TbJ A^^O^X^UTliS 
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2ft3 ( TOj tt-fe-7Btfj<D«Tffi2 1 t?7 HEMS 

M5A© r a j A^«^$naiSKftsn«o cntt 

fg-SfGND M5 S [2 0 : 0] TH1 2tfe$nT 
^5o ) I^iitnH Mf§§M5A'VDMSBA£ 
E^jSf 5SM*tt^v^ K G N D KZtimmz c i: 
tj;«JWfc roj tsnso 

[0 16 3] roj tffttf r^ffj ©2 2S@CDH'7 b 

lLT£^l*iF/fft/c^>7h2n3c <fcoT, 
+ U7-FttSTttffi*rtO ro] 

+ u e 7 b § fc * c ©fisotii t M fc fc^ © 

T~) % § n + 1 S g <Dffl»©W &r- * £ 7 b 7 n 
+ 1 J§ffiEffi3i2ft3c *ft502O©7-Ftf$Mf 2 

— HOt: 7 b SMtetf-oftjs-r a e 7 b 

i ^7 bfitta^ rnxfi-e^^vy-vtims 
b€£ftSn + i t^bA#fc5*.5fc«>fc: roj ^ 

TOn If 7 bOt^TV 7*gfS#Mt7- KOMH&e? 

[0 16 4] ±ei/fc«fc5fc, *ffl£®7"a y * P R E 
C 2 3 1 rtT^*5ftfeBfHT?fflI*n* 4 0©A7J 
liA*UT_I N (2 1 : 0) ^/rbTS3M?n§o 
i!<DA^Utt4 0©A^7 7f-l N 1 0 L, IN5 4 
L, I N3 4 L&tfl N7 6 L<DAM£iI2ft3„ § 30 

7'>fIM!^L ATCH 1 0, LATCH54, LA 
TCH3 2, LATCH7 GlffiWV (h i g h) T" 

^LATCHIO, LATCH54, LATCH32, 
L ATCH7 6tf3lt$V>T£i;3Cfcfc«fcU 
^3* I N_C LK€^0 4O©HBHrtt*n5§A7JV 
yf-fc^yf-TStfctfTtS. C©Bfim©IHIE, 40 
©A7^I£$£ftLfro7 7 7^ra/ci6E L A T C Hfl 
^±A*77fIN10L, IN5 4L, IN3 4LR 40 
tf I N 7 6 L*S1tft-TS «fc5£ffiU"W (XttSft* 

[0 16 5] *micfovrc7v?<D$-(^y>f<DMtt 

mi 3t^ntV^o 4O0A73€^*W*bVMIE 
77^2fta^ **l5tt7*yf-L 1 0 L, L5 4L, 
L 3 2 L, L 7 6 LOS2«D/Oi"^aS5tl*o *tl6 
7 7f©S2 0^>i'(l, ##OUT_CLKRtfLA 
T C HflffiU^l/O'fctfcfW^fcSn*. ^©fi^ 

[0 16 6] *^©S/XtAI±80©A7J7-F^T 50 
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OA**S®S€5^tt4V\ £T£D«X«it£5<A 
£7-FtfA7J7 7 7M N 1 OL, IN5 4L, IN3 

N C L K <£>#0£$±tf 5X7 5?-eH£fc < fl&ffl 4 O 

ox*t#*aa-An»»* c 5 

[0 16 7] HO*^^n/c^*^©/cJ6Effi^ 
€>nfc 20©^©-9"7^ *XB*§ [1 0, 54, 3 

2, 7 6] a, fFai^AWJas^tu ^©«^rt© 

So ±fBLfc<fc?E, il©llS[±W5tte^TttS5f< 

2ft1\ ttinW&II#*ffl^T&&^d kaco^lfo 

[0 16 8] 4-D<DXMmtf7V?L 1 0 L, L 5 4 
L, L3 2L, L7 6LOl2©^y7{C®TOII#'e 

77^na^ ttjstsiiassw^aM^s E L 

_B Y P OffittlbE <fc D tftt 77f C 1 0 L , C54 
L, C3 2L, C7 6L-\©A7JtLTf«^n5A\ 

xa^n^ti b pj ft^s e L_po?Stt{b£ 

«fc 0 l^-o tfJTJ v 7 TWt i: * n^oSS^ ftk A7J 

7ny£PREC Z3 1O(H*79fC10L, C5 
4 L, C 3 2 L, C 7 6 LNfflEftlBfflSfifc, ft* 

HHWttJ {f^ S E L_B Y P (fflftA* Y 0 , 
Y2, Y4&tfY6ffl) Xtt T-trly^bpJ fl^SEL 
_P (fF»A*Yl, Y3, Y5ZfetfY7JB) 0?£ttfb 
CJ;'3^nB777 c (cn-b?n§ 0 d©^SF<0SH# 

^©mso aybn-7CNT 
L 2 4 1 ©»1»fcl&fiM8i£RtfXf± [v-T^n] 7°n^ 

[0169] 77fL10 LOffl^KlTg±ttOA*fi[ 
2 (D^tt&OimWm R 2 M U L ^ftrmsz tU % L 
Ta?«nfc «fc a tMlSM 5 A E{K*&2ft5o 
iPSglM 5 A ^ P. ©tHTJ 2 ©¥>3ffiE i^t77fL 
1 0L6^©W^O»)BfllSii:^ffifcL.T^nSo * 
Oi<D30077?L5 4L, L 3 2 L, L 7 6 Lfr5 
OtH^tt, 2 2^7b©7>^ULCH5 4 [2 1 : 
0] , LCH3 2 [2 1 : 0] , LCH7 6 [2 1: 

01 ^Lxmmcmmtawm? 2 a, ?\kr 

If? 3 A&ttZftLTmmK, »JSlT3tf^77^ 
C 5 4 L, C 3 2 LRt/C 7 6 L^EgJM^nSo 
[0 17 0] *mm$5^Ttt, #»n»tsP 2 A, 
P 1 A, T a j Rtf Tb] *WLT 

inSSP 2 Atco^Tte-T^A^ia^y^L 3 

2 LA^A^^n, flS©A*tt7Vf-L 5 4 LA^A* 
$n§o (L 5 4 LlC7yf-«nfc) A^flY 5Rtf 
(L 3 2 LC5yf-*nfc) Y 3EO^I4inJRBP 2 
A^50tH*ffY5 + Y3K^L<» *ntt±Ebfe«fc 
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5fcp (2) t«u\ SEoT, MpH^iMoX7J 

Up (1) , p (2) Rtfp (3) %£j£tSfc«>fc:ff 
8A7Jfc*f£t5o *HI, L5 4L, L3 2L, L7 6 

Lt7 7 7^ftfc«X7jli^mtallt§p 2 a, p 

1A, P3A^^LTaJi-T5/b\ ^OgHfcLT 
£USp rffij (i^77fC54L, C3 2L, C7 

6l«jmv\ ^o rsKpj m 

s e L_p^ffiiiA^tMbTii^ttfk^n&v^5-e 

&S 0 

[0 17 1] A7J*o<y*f^IN_CLKOgtt{fclc 10 
iD(Bi7 7fC10L, C54L, C32L, C76 
UC^y^ftSffi^ «X7JY0, Y2, Y4, Y 

6XttffRX*fc-3V>Tttfcft?feArttfP0, PI. 
P2, P3E«5L<ftS. X7JY (1) (ifU (-1) 

t icstu ^naoEftSkfiSsn*. 01 2 

£^ft/c£?fc, iKDfSSttflY U^ttoSL*^ 

1 0 fc3*Lfc <t 3 K 2 0¥7» £-?x%m-£nzi£tt 

CO 1 7 2] Ell 4tt#8EKfett3£B7ny*CB 20 
LK 2 3 2©ff£U^7-*r*f-+*asLT^S. 

^0« 4 %m*m 5 «Hc*OJ6i^a <y ^OX7J 
ffl*T£HS* ^.iii: &BX{i#J"jS £ & % . c ft (i ^ 

*TArt©atefc»**?^om*sA*ofcafcra 

[0 17 3] ioT, A7JffiI NO [2 1 : 0] fttf I 
Nl [2 1 : 0] (irV^'^^Zlim-fc^T2e7h© 
£^7HcftJST3 4©7 7^fc£oTT7M£ft 30 
5o 2iaSSK:fc^Tao^* CEOffifclEfc:, £ 
©fifc&fc) ffi#t4fcii>fc:, «±ffiUyb (MSB) 

±t&.eyFtjgwi5. c©$aa« tossm ( s i 

gn extentionjji LTftBhTV*. fiE 
t>T, XTJffi I N 0 2 Vf 7 hf£ttT?r>7 

h^ftTI N [2 1], I NO [2 1] , I NO [2 

i : 2] tL-z^nrziy7VLkxmm^r^o 

A7Jffl I N 1 [2 1 : 0] (±Blt2O0fif/c'l^f 
ffi3g£ft5. XTJl N2tt'>7h$n, I N2 40 

[2 1], IN2 [2 1 : 1] £4fi£t3fci6£M* 
ftS 0 *n£01ffiKOS'7Mi2©77**K:<fc39J 

[0 1 7 4] Hi 0fc*2ftfcJ:5fc, A* I N2, I 
N3fi J tOlBlf?n/'c«ac 1 sRtfc 3 sKX-dZ^ 

gsfts&gtfssfeo-e&s,, &Xtj i N3Rtfi n 

HI 4KaVr<J:5 fc, ilftkMoo-^iM^'J 
■fe-7*JISMUL C 1 S, MULNC 1 S, MUL 
C3C3, Rt5MULC2 S 2fC<fc^Tff*t>n5. JS 50 
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gp© I N 2ffl©ft|?§5tt£i£3tl?f§MU L N C 1 S Tfc 
So ^©tli7Jti-£flC 1 S(C«3t@2ft 

/c{ffr5>aH2ftSo SSHSSMULNC 1 s%m 

iDffftton, ^ft&M££j£tSu,h^lTOSo 
i:ftffi£®©ijpS^e^«©0$©$ffl£Wt^-rs 

h\ mmw%&m?z c t a^ofcfcsjssstfffl 

[0 17 5] *^©0*Lf^lM^*5^T, 40© 
n^^ffiSESllSSMUL CIS, MULNC1S, 
MULC3C3, RtfMULC2S2jU^*h*o fe 

S&?>«\ £^ftfilltt2 0©5IIIM87£W\ t*fc1>c 
1 saffltc3 s^SEfcJB^TfT&SCfctf-Ct 

So 

[0 17 6] *^tj:fta\ SUfgMUL C 1 S, 
MULNC1S, MULC3C3, RtfMULC2S2 
ttffSb <tt*-vU ■9--7TB-e«0, *-ft«2O0fil7J 
7-F, tftfcS, A-F7x7HSWe?T&fcftS 
^ofrOinllolgaKSfi-r £$2ftS* 

Ci:*«*LT^So SHS^50HJ73{±2t30 4A* 
4MP?iD*SBT2, BT 301^*1*^© Aft fcl/Tft 

H£ftT^So 

[0 17 7] ffi»*0*£W-©fcfc, f!SS*^0 5-3 

ofli*/Utt, c ©7M©3imt aa»Tt s ©t\ 

Jn^©flffit5A7>U£^Sft5.fc5£ffifrftT 

fest'tBS^ftT^So ^ft^©s$rafp?2fts^ 

IBfrftSo $oT, HI38MULC 1 S©^-©tti7JM 
IS [2 0 : 0] «in5$BT3©A7J Ts a (s av 
e-a) J ©{gfu2 1 tfy F£8Mfo*ttS„ 
[0 1 7 8] 01 4K^$ftfcJ;5t, iPWf§BT2& 
t/B 13^0 5 00X731* T^fJ (sp 1 i t) J 726 
S£?t^2ftSo iitl flPHfgBT2© Tc aj X 
7Jttg"Fffi©2 1 £y htbTOX7JT-$SMC 3 [2 
0 : 0] 0±tIN3 [2 1] *Wt5«taCS*nT 

USt, ^-OifraUfflOXTJ Ts a] l±GND, 
M3S [19:0] ©±OGND-e&St^£ftT^ 
S 0 cm±2OO0^<lOX7J7-KO2OOg±ffitr 

>y hiiLTlto^ftSct^fiftt-So ^o<j;5%}iin 

OtT<y mJWD* 2 2 e-y hii|OX737- K^B^JftWF 

[0 17 9] ++yHz-7"JltlffffiBT2RlfBT3l±2 
OOg^S 2 2 e-y hOXTJO^^ U 7- FRtf-fe-7* 
7-F:&iPSLT2 2E~7 hOffiTJ-b-7'7- F T 3 S 
[2 1 : 0] Rtf2 1 H~-y FOffi7J*+U 7- FT 3 C 
[2 1 : 1] ^«fSo it)T, #iPg^©X7Jf± 
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8 8 If 7 Hftf&tK &ing2§frP>©ffirt&4 3^ h 
HffeSo 01 OE^L/c<fc?E, ^-fU^-TWaS 

BT3*^otH*tiinS^n5Kit, 77fcio*^ 

©fflrtttfiLk£©T-*l&tfefrS7yxC 5 4fr5 
©tHrti:iS-&2ft5o LfrLfctf5, rg£ (co 
mb i n a t i o n) J tt±£r-*il(&fcfcti-«*n 
£ffi<Jnffm3«11-3*?E«^l±ftv\. ?©g 
a, 0 1 4 E^t <fc 5 fc> ^©~>7 YlEftft-imm 

ftsnfcArtffi iNoa ±#*+ u Htfjfcsasti 

-Dft^fM^ftfcArtffi i n o tg^m ^©~>7 
hZftfr-Dmmitztirckm i n i «i^-©An3i 

i n o Rtf i n i ttinSggc s o iz^xm-m^n 

[0 18 0] iot, 01 O^TjkLTc^Mh^n 

s&saai^tf, Hi oEffli^fcftS© jn£ 

»/SW»2 4 014, ®ftffft%t>ftZ&&ff&ZZ.£ 

4 oit7?fc i ocffirtfr^iss^na^^rc 20 

5 4fr?>©tfJrt£j&S£T3o CftttC 1 OfrSOW* 

*c 5 4©tfJrt©ffi»fcin)rrSi:i:!:EI-"i?*5o 

[0 1 8 1 ] 0 1 4 %Stf#liat5 (0 10O77 
f-C 5 4 ©HJrtKWJStS) I N 1 ©Sf&(i 2 2 t£ 
7 h©Art^^-£ INI [2 1 : 0] (*ftfct*© 

ioTfffttonSo I N m«!, N I N 1 [2 1 : 

01 sipsscs io±rt r^-7'j ArtE, 5/7 h« 
n^o^rat^nrc i n ot*s#j51-3±£ 

+ UJ Arti:fttffil&$nSo iPS^CS i©±#a$# 30 

I N 0 § [ < INI Effi^-rSMSA^fffttonSo 
[0 1 8 2] 01 0E*L.fcT#©2O©T-*lSSE 
feV^Ttt, 7>B?ii»t5*^l7' u 7 7 C B L K 2 3 2 

©fflrtT±^©2oor-^SKrtK:^5n^ftPing 

ffijp3?§§«£El< U ^-7M?^M^ 
su\ cna0i 4t^mt^„ 01 otibfc 

S^ffiMoT, MIC S 2Rtf C S 3{i**l5© 
Art LT I N 0 ~ I N 3 <D%MLMmMt 5. 
[0 1 8 3] Mff§/MJI§§C2 0~CS3<D#^5 40 
©2 2 (£7 Y<D*\ >JRtf-fe-7tftfJtt, #IHinJH&R 
ESO~RES3fc*^T4iMW£ft*. CO»ff03it 
#E S «k 9 E, * + U Rtf ■fe-^m*OdPttr 
^*;l/&t1-©#!ff7{i <fc < a»2ft50-p, c ;:t*© 
i^l4Ii(iL%^„ 01 4E^fJ:5K, *+U 
•t-7lPgg5/SgtsC S 0~C S 3©-fc-7tfjrt«ft 
iStSiWStalfiHfRES 0-RES3O T a j Art^© 

2 2 M.y h<DXtlt LTSiSffit&StlS. 

[0 18 4] C©»B-ettfi<»l6nT^*J:5K, 2 
lS©2©ffiSa j e©tryh©&4*£itel< ( ru * 50 
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roj e, xa ro] * r i j e) » ri] ^ipsta 
cktjjQfessns. ^© r i j Eov^xae-yhs 
KoaKE-6K, xa^in-cing-rscttf-et 

So *+U7-KOLSBttWc T0J ■?*•), ^ttfi 
*+U7-KO0C&tf0 1 C^/SMfRESOR 
R E S 1 E Art £ft£ J: 5 E y F G N D ESS 
5 £1 1 E ± T*^©HMmifT * tonSo L 
frLfttf^ 2©ffiS£fco;fcffi*£jS3-3fca£iSg 

sc s 2Stfc s 3©*+yajrt^© r i j ©torn 

*EVDD*0^5fc»fc*ft&T-*7-KO 2 C 
Rt/03 SOL S B*fitffitt5<:fcE.fcDllfTS*U 

j thtj:t>T*+y7-Ko roj lsbb, ru e 

«fc5in£fcl^F©«J:5E rij EK*ttb5o 
[0 1 8 5] ±EoaiEJ:t), roj tt, (LSB£ 
^yKGND Eg-&* § d fc E «t 5 ) * -v U -tr-7'iP 
JfiSCSORtfCS lfr5©2 1 t£y h©*+U7-F 
ELSBfcLT^iP^nS. ^'J-t-TlMCS 2 
RtfC S 3fr£©*+U7-F©L S BB*fj£T3r- 

*5i'y£«*&WEVD deists cfcE«fc!> r 1 j 

E^L<ia£*n5o i^T, ##ibnS8RES0~R 

e s 3«iing8S/»g$c s o~c s 3*^otUrt*^ 

HLT2 2E~7 h©ttirt{I^OUT0 [2 1 : 0] ~0 
UT3 [2 1 : 0] 

[0 18 6] *^©^MiJEfcnt§ I D C Tm<DZ 
0®PJjfiKOV>TttH l 4 EBoit^ c h/b^-f §c S 
1 Es WXBW 5 >^fi€aftffl7"o 7 * C B L K 
2 3 2Ttt£#Sft&l\ ^0«l7"n7^ 

'\oA*ifii j fo*i^n 77232 mmwmm 
&&m?Kfe*>KmztiT%Kmzn%, m e, 

7 i -*7-H©l«ftiSSE«fc^T, SMS (Xfi'> 
^< tfe^T©fI©/cJ6E 1 03i/H3u££@J£f 5) * 
fftfflv^cfctf-pt*. cnaEffi^Eov^TS^A 

[oi8 7] ^mmmmmnmm^ mtrz^ 

ft Art *Wmm 5 C fc E J; 5 , S /c¥»©K? I t^fe 
d f: E =fc D *SWE in«\ -> U n >lf ©HI 

E*v^T^»©^tfn«©iamffii*ffl^s c t^Tff 

5iltT-fe§o 09*tf» 01 4E^Lfc<fcaE, 
S3HH8MULC1S, MULC3S3, MULC3S 
2RtfMULNC 1 S^Tii^]«©SB!t«:Wb, x-* 
aS§E*3^T^I-©^Tr-^^S^An, *ft£J: 

4 0©^T©^ffSgAWElil^-r5£li:A^t 
§ 0 iintt rpfg (b o t t 1 e n e c k s) J ^r^S 

^^ilT?«-S©^7 U;MSjB©fl|j£*£T# 
S C t A^T' f 5o * + U ■fe-7Jq JfiB B T 2 Rtf B T 3 
tt*tlES< U t~7*bmmRX}UW%s<D& b EMI 
«E^BtEft{f-r§ d t t?t 5„ il©^!t©?»ttR 
tf^©«?©^Wft [RlBf fijffl a*%HJ!©HSS^E «t 
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[0 18 8] 01 5tt*5fiECfcfr**tB8I7py* 
P 0 S T C 2 3 3 (Om L^mm^LT^Zo B 1 
0 K^LtzX 5 C, »&£ffl7"n 7 7 P 0 S T C 23 
3©±S*«tia, «»dl. d3, d5Rtfd7t± 
oTfta^n-y^©ai**5ll@f5 2:fclcJ:0h0~h 
3fI^j3Scf^il^^ M^^fiitWc&g (k) 
Stfh (k) fcfcfdrrac^ &tfSffiHia%£j£'f 
Sfcfch (k) ffifr5flfrt3g (k) <I*HSt3<: 
i:T*So ill O&tf01 5WS%#RgLT, Bh?7 
f-^JSttftStlfcfct, -fft^»@S§tfEN_BH 10 

CLK%ifl^;WcL/ci:t, 1f&#!7n«y*POS 
TC 2 3 3 fcl:&iI7n y £ C B L K 2 3 2fr?>©ft 
S-r«m**77^BH0L, BH1L, B H 3 LRtf 
BH2LlC77ftS„ MfiHaBAMPI E N G HRtf 

J;t)77f-G0L, GIL, G3L&tfG2L£ffift{fc 
Lfcfctg (k) , g 0~g3{|«M)Sf5^'yf-G0 
L, GIL, G3LatfG2LE77^«na. 
[0 18 9] J&gLfctFSA*!, "f ft^ffih 0~h 3 20 
(i, EN_GHRtf I N_C LKtfiSU^l/Cfct-S 
ffiftSJHBD 1MUL, D3MUL, D5MULRtfD 
7MUL*^L,T77f-H0L, H1L, H3LRtfH 
2Lt7-yf-*n«o *n6<05HWBl4d 1, d3, d 
5Rtfd7E«fc?T#4£JfrSn3. »$U^»J£ 

^mms.Jtm-£^Mc&m l < i> 

THUSST**. 01 5K*t<fc3K, ^<D-£«I 
JHS^Bo r*+y ( c ) j a, WTta^sfcaSfc 

^ft^TftlSMIfsHO A, HI A, H3A&tfH2A 30 
-7 (s) J li, JXFK>£'<3*S§§1«8:£ 

[0 19 0] IK, 01 5lC*t£?fc, HOll^DL 
SBtttfSb<ttH0KOV>TOSiSt« T^-7"J W 

S2oi?yb (hos [i] tttjs-ra) a ru t-fe 

7h?W„ -£«SHS8D3MUL®*iry&tf-fe 

-m*jfre>0T-*7-F&, i^«£^(BingSH i 40 
A-\©A*tbTMa?n^o ^tiB^a&t/^iinS 

HH 1 A'NOA^CfJ^o 
[0191] #f»<fcn«\ $SSIJ¥$D 7 MU LS 
tf D 5 M U L 5 -V U tfJ;fr©£T © 2 2 If 7 b ttfl 
j£-r5^)BiPSSH3A&tfH2A© Taj A*£E8 

s^sna. r-b-7j HtijoMSBtHftS 

* 5r-# y F G N D 3 C K J: 

UaSIWK roj t?ti5o a^felDCTf^rAtt 
±E©CC I TTttttfcfe^LTttlfcSft*. tV^ 
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ofeftESttttt i o o o Q^ry-f)^M.%Mk^t z> 
t\ r o j xtt r i j 'vueoflte ft e 7 h 

fe„ r-* 7- F O tf 7 h fc b T , <D 

mmimmmms.®.t%rcMzii.2 4 if 7 b*< 
s*&B"T?s**k 2 2 if 7 HsT-^u-vrnm 

^TCC I TTg?f&©MfS?t3E^ttMStL. 
fc. 

[0192] HSttoKf^DfcT&tfeg&EAi^ 

©fefc, I DCTS/XtAT&£t-£7-FS£^< 
©StRlf 7 FfcBSilLTxv-tf IMWt 
-FO*££ffito££i::teCfctffSm2ftfco ^7 ha 

IHttfflj^tf, 1 «±0*+ U If 7 bfcgftWKfffi&Ifc 

3SS0-T 5 e: i: c <t 5 Mart LT fe 
[0193] #8miK:i5^m if 7 

S\ r-^7- FOWJl? 7 h 14, 7- FtffflRXfcHf 

tftoT r 1 j xti roj essww«n*. af> *ft§ 

*7-K GKBttftv^ §fSb<a-fitie'7hS 
tfi7-F) ©LSBtt r 1 j xji roj eaiasti 

5o CC I TTrXh^HfT^n, *0*ffOfcftOC 

c 1 TTimm&ztmibft&o zlt, b 
f± r 1 j xti roj oflSfitaMW* tu rXbttS^T 

*tl5o fflOr-*7-FOLSB (X(iLSBs) 

r 1 j xa roj cBffijsft, ^oisiHi^^n 

«^ft®$iJLfc7-Frt«ML/clf 7 b©tt^ft 
ffl*-&*5-&fc»1-5«EtHl!&iKK-r5 C fct «fc <0, IS 
©fMWftlS^^S-r § «: fctf 5. 
[0 19 4] UA^Uft^S, C©|0tWftM^«<H^ 
#^Sft^ftP>«\ -SfcRHSISD 1 MU L, D 3 
MUL, D5MULRtfD7MUL^5©ffi7 l ]^ISin 

wm 0 A~H 3 AKfcv^T«©^S-e^?^nTt 

fiV\ ; f©^jS-r§V75 L H0L~H3L©A*©ffi{u 
2 1 If 7 H4*ftBOA*OL S B tRtcyvyVKB 

[0 19 5] H79f (H0L-H3L) M'G77f 
(G0L-G3L) A^Otti^tt^lSiPeig-SlieSS 
7 OA, S6 1A, S 4 3 ARtfS 5 2 A'NCaRtfb 

SUB^U^Ofct TbJ A^^r Taj A^/b^M 

JH-*j:i:*Wfton5o ±S©zoo77fSH0L& 

tf G 0L> HI LRtf G 1 L©^2 (f 7 httttTt^T 



(33) »H¥8- 1 7 2 6 2 4 

63 64 

[0 19 6]^(BiPSffi-flSSS7 0A, S6 1A, OjgSftlftff *fl* 5 o * 2 O P 0 S T C 2 3 3^5 

S43ARtfS52Afr6©m*ttlSS7yf-R7 0 ©flirtttffiS©2^I DC Tg£T?S!K ^tlW? 

L, R61L, R4 3LM~R2L(C7^Sn§ 0 I ftfflSS^ny ^rt?*fr*nfelBlS/7 b**7*y b 

1 5b£**«fc5fc, HPiHg/WWSS7 0ARtfS6 1-£fcJ6t->7 M"S C £ £ *3«©£i££fc^Tl 

s§is7oa© r a j A*^©A*7-FoS2ey h j5mvmz*7^vyt%rctbic>m%2K£mw- 

&G0 [1M] , GO [1M] , GO [0] tfSS„ S £tT&5o 

^m^ttllfs %2<D\£y Hit GO lMfcWtSfcft [0 2 0 0] ryufr-fayEfie-aTco^oiD 
b^nSo JlPSS/iSeSSS70ARtfS6 1 A 10 C TflBi (H 1 lE^nfct>Of:ffSL< ttl^-T* 

^©ffi©A*©ig2©e'7M4[wafc«*n3o £© s) ttffgb<ti#S0¥i^-eS5o cma, @e§© 

t£7h»Mo©2 : l^W^U^tfHO 1MU #-©fWJ TUVALU 2O0gg&£ftfFrs C i: 

X, G0 1MUX, HI lMUX&tfGl 1MUX (0 A^tSidCB^ny^U-h^t^SSa^ff 

1 5b©££0*) fCfcoTlfig^nSo *fSE£*5^ #BLfcl#7^tf&g?ttftl/Vii<, ^-©0ES*^ 

Ttt, *ft&Ov;l/?-7V*lNiADDRtfSUBffl*§ SO|SOfc6lcffll^n5^5tfet5M©M'M 

OARtfS 6 1 Atf-fey (ADDtfSb [0 2 0 1] 0 1 6-03 8 fc3RbfcJ:3fc, *38Bfc 

, %2<D\>vY (HO 1M, GO 1M, H 1 1M «tS^2 0»SU^i6l5fi»Jl±#-0 1?fcn^ft*ffl^ 

fttfGl 1M) tflK-feyb^n, SUBfg^ffil^ So u©^MiJtt±faL/cJ: 9 411^7 7 Wh© 
;l/fc-feyh3ttfcfc5tf, *®S2©tfy M4*©£H 20 fcTH&B&k. bftl\, Si Off* LV^lWfcfc^Tl? 

©If 7 h£D^£ttfi»^^t|fS5o ±IEbfc<fe Tl/^o H3 8fc^Sti;fc<fc?£ J fn5M: rftjS^MSiP 

©ff* u^sswa^y h?i^M%tt?o Lfrbfttf assorts. $ i off* bi^iKcS^t^ts 

5, dO^SKftV^T<tt)/J^^7-FeOiPJjS*^ ^y^j tt2tiffi© r7'Jy77ny7j Rtf 

[0197] 4O0SEttXttfiffi«*l4W*7'y^R7 [0 2 0 2] 1 &7E I D C Tr-*iIB/< 

0L, R6 1L, R4 3LRtf'R5 2Lt^7^*n ^^>«lC|ul?nf:77^yWty|? 
§c ^©ISIR^»t^MUX_OUT7 0, MUX_ 30 ti, mm 1 8 iC^LtcX 3 £ 1 0©7"u y ^©* fcfi 

OUT 6 1, MUX_OUT4 3, MUX_OUT5 2 &Aft5>tlT^£o <fc-?T\ 2 ©ff £ bV^SEWDA 

©«©^T«^©tf^yy^0UT F C^77^ tf^££S^'J|s?©t«T 2r-*©Rl£l£>Jy 

tx^o LfcAST, smft^^^n^llttyy^ 77Wa9tWW 0 Hi 6Rtf0l 7fc** 

5yf-*ti6)e*«{k**fi!:fcK:«J:5W#Klli»PT« ftfcJ:5fc, 20©r-*XHJ-A, t*b^bU 

[0 1 9 8] *tf4±ffl7nyyP0STC 2 3 3ft© 2J (-g 1 &7G I D C TfcftU SfcT R AMrtTK 

yny yfl^^WfS^tO^OM^H l 3 b&tfH tSSfc^ftT^Sx-*) «, BfP^S^St^T 

1 3 cKSSftTl^S. ±f2bfc*9t, 20©1^tu i ! -rm>W7' ; 7>Cy<D%Km\2ti%o 

IDCTlrfm, 2#tEI VCTZmvfcibKT-* [0 2 0 3] #£UH£tJ^t\ &XHJ-A«r-#1 
OH©atS8ATE5iJ«tfrftt)nS. ZiX.Wm 40 B/V77>Ty0*£T-*Eg©^l'-7 , *S<fc«> 

ffi7'ny?P0STC 2 3 3 t^mmm, *» EMllt^t^. *©r-** h U -Afct, 0 1 

^O^fflMEintf, 5te?\ RAM^U0EPf©« 7. 01 8Rtf0 3 3£7KlT£5£, *n£tfT-*l 

©IB'llU-y Hc£»©£iWJ/3ft£ (XttfrfflS gto>V77^T££Ji^5ft*0T-*lB0aj 

£) I3tS*n, ^LT, ^©*tu4±17nyy^©A* ^T'r^>^-U-7*n§*5^y^-'J-7*n 

©a*n?»/£i6(c4±a7n77CBLK 2 3 2Rt>*« [0 2 0 4] *f8BKfel/^Ttt^ T 1 \mt>?$mt& 

tt±fcl7"n 7 y P o S TC 2 3 3ttW«$5. V\ T2^T 1 fc-f y*-y-7 (SSEH) ©^CSiJ 

[0 19 9] fr (?IJ) TfHIi*^ ?0 «t) tl»ffit ILfctLTfe, X*^v7rtt^-l'7 , 7>l'yOflC* 
Cfctt, S2<01*7Cl DCT©MET-*©»fc«*. 50 ©r-^^8A1-^tT*V\ CtlttT 1 O 
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r - * X h 'J -2* %M h £ a E&#©^ 7 7 r V 

S<fc 5 H$ TE ^©A^JX h U —hi? 5 ©r-* 

ti& 5 , * C T'fiX b U — A T 1 5 Of-* ttfl^ 
TL a t c h 1 (0) ~L a t c h 1 (7) J £fflV>T 
7 7 f- 0 ~ 7 E Tig 1 ©g$© fp- E a - K S ftT ^ 
So ioT, T2frS©T-£&03 3ESLfcfPI% 10 
ffl^THl 9t^LfeJ:5C l~La t ch2 (0) ~L 
a t c h 2 (1 5) J fcn-K£ftTV3o 
[0 2 0 5] -Y>^-U-7tt TT 1 0K2}fA(i 
ns e r t) J &tf l"T2 0 K 2ffiAJ ff^EioT 
»£tlS 0 at©lfi#©7GT*«^ >*-U -714*® 
fl*ttf ! U^E ftofefct^US. Lfr 5 , 
TT2 OKSAJ tflb^;b©B#ET2ffl©7 7^rt 
©T-2tAW£imtE}lLT^ftV^5>«\ *© 

4 1; s s T*f- * ©^ 7 7 r u > yzMftftimif * e 20 

[0 2 0 6] «gt UT#5gB£EfcttS±ie©^7 7 7 
U^W^USftSlf, tbtSTCtS rs^ (s 1 i pp 
age) J S'T2 0tti*'P4i;ftJtntfft5ftVo T2 

t / < 7 7 7 y urw- 5 mm s 1 1 x y 7 7 1 
s 0 T2Auy77u /W7 , 7-ryotptr-*** 

frft^&Btf, r-*a»©a*-p*OT 2X b y-A 
m le^t S 7 7tf So c ©*> 7 7tt 

* © T 2 HJ*I E T£ft<DA 7 7 7 U > 7"©Hffl tiot 30 

msztiZo u©Ma«^T2-i^7ci Ddt 

ftfc TOb/c] T 1 - 1 #tg I D c T£&£*tr5 i: 

st>n5o cct, T-^xhy-A«^-©zggr- 
^»v77^yKP^^fflv^©-eBfF^lfkSST 

[0 2 0 7] ^fgSSfcfc^m T-^^'T 1 EAtj£ 
ftfc^fct mU (R e c o v e r y) J tfjg^S„ J t 

htt t 2 ^ 7 7 7 # t i Rtf*©T-*x h y -Atii 

l^</ci6©S#TSSo T-*fcUt I DC TfciflU 
t57-**^^f S3 4© TL a t c h 2 40 
[0] J Er-#X;U*£LT*SftT^S 0 Cftfi 
jg^fiT2A^ J E-0«!:5tU *tU4T 2©/<W77 

y v^fc*oai*TSi/'c'rc:fc?S5„ tt 2 d o u 

tj fi^Rlf r 0 u tj fi^tf-^7;l/©$tfctt^7 
7'*ftSi:*tWHttH3 3fttfH2 5fc*Sft«. *© 

7 7« r-* x b y - s kvxom t L 

TfflV^tlS. T 2ffl©^7^ ; f©r-^%lfA'rS 
Efctf S^-V 7 7AV^7 7 7 'J >?<D$* 7 7t Rl-Tf 
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[0208]POSTC 2 3 3rt©TRANS FOR 

m caao e«v>t, ^>^-y-7?n/cxhy-A 

ttHl 8RtfH2 3E^tcfc5E^ rT2outJ©f^ 

TxVy^-y-7^nSo *© i~T2 0 u u 
x b y -Att±iBLfe± 5 e *OT-m ex y 7 7*' 

+ y7*£LTV»S. HI 7r-*LfcT2ou t [14 
3 : 0] H\ HI 7©7n7^ ri DDPMUXJ fc L 
T^Sftfel 6 : l©v;I/5 L 7V^^7P7^tA*1- 
So v;V^7b^-9-7u7^aH2 5tSU/cJ;5t, 
[H^/^7 7 7 7p 7 ^f*l© 1 6 fitfi©5 -5© 1 {uB^?) 

7 ^ t <fc r> riK^n, w»a ^7 taztoxti t 

T T 2 ©^ 7 7 7 7 7 7£T S S T'^©*> 7 7«B 
tSo c:©^>77(i*^tLTffl^&tiSo v;^7 
U^7n7?fr?»©ttirjXby-AT2D0UTtt{if 
t$ti/tr-^Xhy-AT?$So 
[0 2 0 9] ±fELfc I D C TSifiOfeJ6t*»KOH 

nfiacc i t Tset^ats-^ #^T^©ig 

7n-xti7 o-OSnft < if (M*. 
«\ maotCSKr-^ 7- KO»5 tf 7 h ^Sfiffilt 

ct^-etfco 

[0210] mmic^mm^7-Mtm<Di5 
jSi-sfc&tffl^fM^n©Kffi£ffl^TM-rs 
iqg3gT*+ y *fflv^Tv>5SS«o»f Jin 

TT^IISB, ffi©^MK3f)^-^7n-X«7 
y^-7'n-%B5±t5/'ca6ti:5n5©-P^*^o 

[0211] mmiD-mmw^^r^ w^t- 

r-* 7- v&fffxmmmLrz.Mtowt tr 7 
b^a^ns^ -£^©©^7 hfcjmsu ecu 

^^©^^^^©SS^ffFffiTSi: So ^© 

at 5 c fcEfMtf ass c t^bfc^^n Mists 

5 ©^m© 2 issue fttf s 

roj m&mm#&ct&-vz%o 

[0212] *ffflBO±ELfe«aioSi:«)K*V'>T 
tt, ^©dtA^f.nSo £lr-**HJ-.MB* 
Sltt S $ 1 ©7 7 f-Rtf » 2 r- 2 X h y - 



67 

OllfS^.RAMt±T-**aSiU fMf2 7'>f 
XfcgretS. %2?v?Rmi yvftffi&L- 

7 f cii^s i &tf® 2 r-#x h u - A%ei-rso 

L^L4*^, * OS 2 5 7 f-oa&fiJtttS 1 7 7 f" 

Sa - 7 F i±S 1 RXS m 2 r-*X F >J - AOfcfcEffl 10 
O^nSo Ht, ftSOStS^yFfcffiELTT-* 

fc, ftg^yFKr-^fcBtU ff»7r-bi>'X 
*©*£!glv-*^F£ig*&tro S25f 

su-b*iHrr5fc»K^x*«HT?*5. #©x 
T7 s i a»->7 f \s*j*zm%.<om}icM 
u fr^%27v?mfeT-t>mmK2nrztz, 20 

% 2 7 7 ffl^f-^ - 7 F t m c i: t- 
2d3o *C, g2 7^*^T-*lT?»;fcSnft^ 

7 7 f-^r-^ftSW-AnTVftU^ * S 2 5 7f-*fc 

[0 2 13] B#|HP»ifc^T<O*£rc0Pfflfti»rc 
MPEG-2K*J^T, Kf*Stf*-f-f*f-iill 
M P E G - 2 s >Xt AX F y-AKtS^TlfiSSSttafll 

RIJH*«Blt5 20flDfl|«*^y, 9uy9W$RXf* 30 

Bfr^ T4- (now) j ^g-rA^a&^^/c^tcffl^?. 

§ £ 7 tc Wfl^RSlT-tlin-r § * 7 y * kf § 

[0214] *4k7»zvf\rfuy : 7h om, £r 

OifeM (stream) (D<£lcWfrft% 0 ^TtO)i§ 

5o MPEGKfc^T, ■>7,rAXh l J-A(Dif"\(±- 

©?^7, 7n9y]*im<y9£$ (PCRs) &tf~> 
XrA*Py*»P (SCRs) -F*«o *«MCfcv^ 

ffi-^ffilSnSOTf, PCRs&tfSCRsOHoeS 
ttlHHi:ft5ftV\> PCRsRtfSCRs(i»iS%2 
7 MH z (X«#3/£ v 1 /2 7 X 1 0 e 6) tffiSf 50 
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3 lift 3 7 f -71/ F *£f 3 9 0 M H z ©##t M £ 

WfiBf IHSgEt i Xf 7 7°£ £ 5 * tttUf ft 5 ft V\ 
^^AX^y7&tf^a7^S*l±S^B#cg^ 

#£©xn-^©7-*T^7^©llfK7 0 t"r* 

Cfclt 5S® fc K5f L < fttffttfft 5 ftV\, 
[0 2 15] MPEG^tg^tattEfi r^XrABf 

tr 7 fx f >j -A^fc^T, mmm^mmm t 
^^Ax^yy^jiv^tfasbftn^ftSftv^t 

ttg|jgT?tSo ft€ft5», ^©ffiOft»5»^P7^S 

[0 2 16] H3 9ttS*XhU-A2 5 OfcfptMP 
EGS/*Tl*XhV-h(D&mjm*&LTVZ, -is 

iMW*n*o eftol^, 7^-txa-7 MiBMSn 5 
[0 2 17] Sfc, ->XrAXbU-i,Ofp'\a-SO 

^-yax^>72 5 ia^a*xbu-A^iii^nT 

V^*. ^©^^AX^y7t±^S*XbU-AK)hft3 

#sr§o ^n&(D^^Ax^>7(i3i^ (7w?>r 
-> 3 y) ^^Ax^y7 rpTsj tbT#s^n 

So 

[0218] ef^-f-^S^ic> ^^Ax^y7o 

S20»S*^«*n, TU-Y*4k**y7 TDT 
SJ fcLT#BStnSo PTSA^SLAOPTSRtf 
D T S <DHItfBi#ftBi^*5 t/clj-D T S l±#St 

so-e, ; en?.2oo^-rAx^>7oHoi¥iaftMii 

tt*»WT?ttKi Lft^OtfffiStac fctfTtSo f 
D-F^^AX^y7 (DTS) S7ma^yh 

(er^o^o^ji) jb^«ns^tB#H%sst 

§ 0 Xb-tfyr-^ay^-YAX^yy (PTS) 147 



£>ft3 0 CG>#&, PTS&tfDTSttSVEtSL<ft 

So 

[0 2 19] LfrbfttfB, MP EGlfr^Oa^tte 
It, i^«S*Sft5ffl£/3f£©HflH, ffl*t£ &7b 

^?ns 0 m-ix, %ftt>mmzt\tz.mm^^T 10 

M\ PTS&tfDTS©H£{iMgtf*So 

[0220] *m£&^Timm^mfc®m%rc 
aiat«o -tot, c<0#»®sn££iigAreta<fc 20 

[0 2 2 1] #5BiH0#$ U^JBSWEfcv^TIi, 
AX*>7>5$?>ftSlH$ittF-*V (token) 

1© 1 Wi:©1f$B©7- FA^ftS. b-*y<D«aj© 

T, flHfiOaSA^flDF— ?^CJ;t3TU«*n*. 11 

F-^>rtfc^a©7-Fjb^scfc%^-rfe«>fi: 
r 1 j ic-bv F^nsasitfy v&h-tyn&y-v 

^Ml^nxv^o i^T> F-*y©g&©7-F« 30 

roj -pa&5ffi;®7-FK«J;tjT^n5. 

F-^v©as*^-ras]<D7-Frto3-F 

tt, v^<ofr©n-F*tf (ffl^e.n5^S?0O7-F 
rt©t*7 F©^K:ffi©1«g%gt2^3/£iMO 'J>Vv 

ijfgtf 7 F8cDt>0-C«}:v\, 
[0 2 2 2] F-*VBM8XSf-* b-i'Wf 

n-#ttfr*r3-^©FI©'i'y*-7i-X-eJi 
2 0©ail©'|fffi, TftfrlS (1) MkLfctfrtr 40 

-*Rtf (2) ^A^v^fim^snsii^Pfr 

DATA Y—tyy (flfclf, DATA (r-*0 fctftf 
fflfffflfcLTien, Wf-^ ( S Y N C_T I M 

So U-fey h€^i:ra«E*5$5 FLUSH 
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[0 2 2 3] *5EKt*V^TI4» 2O©0$©B#F E §IrI$ 

Efe^Tfis 2-o©@K©RfH^t±s PfflL/M* 
7 tfi A § c £ £ <fc 9 fg 2 ©0$r yx 

[0 2 2 4] #BfjHti\ §[1IKK:S*7FU-AI^H* 
7 > £ £{ix. S C i: £ £ <0 % l ©HSSfr 5 £ 2 ©0ES^ 

B©i$HHJfi*fcScfctf?**±3fc , *" J 5. *fSHH© 

^m-£timmm&.f&tzrcib% 1 ©@k*^© 

^B*fflv>«J:kKJ:54*6n, f?U©@S§rt©S* 
X 1- U -AB# 1 M£ fc 2 ©0SSft©S* 

X FU -AB#K©3 t°- i: JtRSJrtVS fc©£&^ 

suii^<, »iai»rttRiaiLfc«fiH*7>**ii*s 

il kick D Ifr^rn-^OXTABtS^Sg^t 
ABf H 5 C t % < , X r A r 3 - #ft tf \Z \f 

* f 3 - ?mr$ t % c t m< t § 0 

[0 2 2 5] ^ili^fi.Kv'Xfifn-^M 

IB*fflv^4Cl:K J: D36S**i, ^XrArn-^rt© 
if r ^-fi^af ra© n if - 1 j±r$ nx eWftK fc^ 

[0 2 2 6] *%KE*3V^Ttt, Z4k7.Zyffrt>% 

^rA^UTfejMtSCfcjb^tSo 04OttS*X 
h'J-A^^-AX^ y Tta^frft 5 *^©^ l ©ff 
S L ^^MU b T ^ § o i/ X r A B#K %S t ^ a 7 
7S?2 5 3ttf*rA7 f v;I/f-7 , l/*U-2 5 4ia^ 
TW^tStU '>XTArn-^2 5 6rt©^^AA7 

2 5 5 tjgfssns j; ? tsjsiwtffiit&sn, 9 0 

kHzT^iin^nSo ?n7^K¥©Ii2©nif-^ 
F U -Af3-^2 5 7 ©rtiJtS. D90kHz 
T^iJP^n^oyXrAxn-^^ 5 6rt©£-f AA7 
y^2 5 7 f:HIS8%i:SnTV5^f A*7>? 2 5 8 

[0 2 2 7] *5SWKiSV^Ttt, 5-YAX^>72 5 1 
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UWfl/Wl 5 4fr?>S*XHJ-A^y77 2 6 
0*^UTi!iin5o 24LZ2y?2 5 HiS*Xh'J 
-Afn-^*2 5 7O«KLtt^l$H0;fe»fcfffltrS 

2 5 1 h 5 7 ©mio*^ 

A*7y£ 2 5 8KfiU**hfci*HI03v;-kJttt* 

[0 2 2 8] ±f3©flffiWi\ ^XfLf3-^OA 
^>^«^^fc?5 9 0 0 0 0M<t-rSO-Z?. ->XfA 10 
f3-^2 5 6rtK*^T*-fA*^>*2 5 5fr5S 
#7. b U-Arn-^2 5 7'v>*rAfltlHSifi8#K: 
9 «toT, v'T.r AB«£T*fi 

h 'j-Afn-^2 5 7 ta^wtmsft 

HJfOt^fc&gfcf So ^fAf^"2 5 6fl 
K.BX.t>tl1t*'(J*ilVyi'2 5 5atfS*^hU-i» 
5 2rt(C«it6tlfe*>fA*'»?2 5 6* 

ny*S¥©ffMn4£^Sci:tfTtSo ffio^ft 20 

WIS 4 lfc^SftTI^So 14 lE^L/c^WiS 
#7 h U 2 5 7 7 ^S* 2 5 3 

2 5 6&tfS** h U-Arn-^2 5 7©ffl£fcfc^ 

^2<Dts^y^ r e s_ t imej 2 6 2*fflV^SC 
ktAOlfig^nSo 2dfl)es_t imeA^y^2 
6 2 SO" 2 6 3 «SjBfiAi^K&tf^+ ^;HEM^« 
{tfl©B» U -tz 7 h £ ft, * C *^ § S KKft LJStt 
So ^©HMijaiiao/cM^Ti/^2 0£De s_t i m 30 
e#7:v£2 6 2$If2 6 3 izMiT^ZW e s_t 
i me*7>^2 6 2&tf 2 6 3 t 
fc^ 1 1 S fc ft l&ft * * 3 c 5 0 ft ^ fctt 

It200es_t iraeA^^2 6 2Rtf2 6 3?: 

S*7h'J-Ar3-^2 5 7F*3£De s_t 
i m e * 9 U -fe »y h t S ± 5 1 ">^r Arn-^ 
rt©e s_t 1 me*9y*fr5©*+U*ffll/' , *i:fc 
T'&So 

[0 2 2 9] llC^Lfe±5£, v/XxABf^ 40 

ZJkilVV&Z 5 5fcffi*&£ftT9 0kHzT*iinS 
ftSo *^K©^tAt3-^2 5 6flOes_t i 
meiJ^^2 6 2Rtf*5SflB©S*X b U-Arn- 
£~257rt©es_t imeA^^26 3«EVE|H| 
SBSft, 9 0kHzT«W o Sfe, S#7by- 
A^YAX^y^±S/7.rArV;V^7°l/^-9-2 5 4K 
«fcoT£*tSft3. cfc^T, ^BXl±a*XhU-A 

^Ax*y7\ AA^y^rtE^snss/XxA 50 



Wtfi'7fi»f3^2S60es_t imeW 
y £ 2 6 2 rtic£$ft5S#x b U -AB#FI*fflV>T:£ 
3-ltiSi;TtW*ti«o 

[0 2 3 0] *OS3-l (a~d) tt^'^P2 
5 3 *S*X b 'J-Arn-^2 5 7 Effi^S El fc* 

LTVSo S3-1 (a) liftlSPjllOfcftEg^Sft 
53-e£5 0 0 4 lt^LfctaE. S*Xh'J-Ar 

E8§RflWgJSX«i£3-l (b~d) *ffl^ 
TS/XtAt3-^2 5 6E£oTf££2ft, 

b U-Arn-^E^t&SnSo I^Si^HXtiS 
*XhU-Ar3-^2 5 7rt£t&tt5ftfce s_t i 
mei^^ 2 6 3 t#£ftSS*7 b y -ABfF^tt 

5>ft, ^LTliOXrAO^MIfflEfflV^nSo 
33-1 : 

a) R#KP»! = (S*XbU-A^^AX^>y-yX 

b) B#F^RM= (X-|£*Xby-AB#l) 

c) (X-S*XHJ-AB#B) = (g^Xb'J-A* 

d) X= (S*XhU-A^f'AX^y7 P -v'7,rABf 
^+8#Xby-AB#^) 

*%KEfcV^Ttt, ^B#raXttS*7 b U-A.T3- 

$2 5 7mmu9.mmrz&mw.t<<f!mt 

feftfc, l*Xh'J-Arn-^2 5 7©rtMcRW-5 
ftfce s_t lme* , »*2 6 3fc:*M'l3S*;*b 

y - a m$ t m. s tu * t the fx r a ©b#i ^ 

tfflv^n5 0 ^HITiEli, B5H©ISS©ftftEPHPf 
KXtcing^ns^ t) S*x b y -Arn-^2 
5 7<Drtj»JEltf5n/c e s_t i me* l )^2 6 3 

[0 2 3 1 ] M*.t£. 14 2tt*%KEfi£oT, P» 
iax%^1-5n^S*^LTV^„ COfflfigH:*^ 
Ttt, yXrArn-^2 5 6 ttS$X h 'J -ABf HI* 
m&L%\<\ ZtDlXb^s S*Xhy-Arn-^2 5 

7tiay5nfea*^by-2».^Bi*^^e s_t i 

me 2 6 3*^at'J-tZ7 h*n« ta^K^T ABf 
f^*Ui>'X^ initial_time25 6EIH©T 
e s_t ime 2 6 3rt©fa«^ Il^XrAHfF^t 
i n i t i a l_t i metEfiSnfefifcOSST* 
5©T, yXrLf^-^2 S6K.Jz??W&ft*t.t 
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[0 2 3 6] 04 4£#!8T5i:, ^rABtlHfc*?- 



[0 2 3 2] #©33-2 (a~c) ttRfH^JfiOfctf) ^a'V^I?li->XfATV;l/f ^b^f 2 5 4ta^ 

©COftttfiSfc^LTVSo 33-2 (a) i±l*X T^ft^n, ->7f ArH-^2 5 6 rt©^ A*^ 

h'J-Arn-^2 5 7£Hlt5ftfce s_t i me 2 y£255fcffi^£ft, 9 0kHz "fttijn £ tl§ 0 fa 

6 3tM$^n/iS*XhU-AB#KOfl*g-rST-$. fif3-?Z5 6flOv i d_t ime*^2 7 

cntt, fXrABfFli: i n i t i a l_t i me zatfl£rr3-^2 7 OftOv i d_t imeA^ 

Is'JZ* 2 5 6 fclHttSttfcfilfcOH&i: LT(WIiaB#M £273 tt5Wcfi»i: 5*U 9 0 k H z 

X^iRi6§S3-2 (c) *ff5ft»KB#£*nTli'> 3o \?T*$'fL.Z#y?li., 33-3tjSUT, fX 

§33-2 (b) £4*5 J: 5 £33-1 (d) tftffl r Axv;l/^^U^-9-2 5 4£«fcoT8€fcSft5. «fe 

33-2: >£2 7 3rtfc£$ft4->Xr£R*IHi:, fXrAA^ 

a) g#*hU-AR#B=f XrABJIH- i n i t i a V* 2 5 6rt®v i d_t lme*9>*2 7 2C*S 
l_time n5lfr^^lHi:*fflO^TtfSStiSo 

b) X= (8$XhU-A#^A**y:/-f7.TAH| [0 2 3 7] #©33-3 (a~d) *ny*gi|S 

[fXrAHffi- i n i t i a l_t i me] ) *lif*fa-?2 7 0 £{$|&f5 C h«WF|[H) 

c) X= (S*XhU-A^-YA7.^>^-i n i t i JB©fcJ6C*%K£jKi;felOO^S*7RLTV^o 3 
a l_t ime) 3-3 (a) A|^©£i6Kg*2n53?;fc 
*5SWKfle^fclRlJBRIBX*#Sfci60ZOO)lpa7Eiffi § 0 H4 4C^bfcJ:5C, er*r3-*ia»2 7 0 

^SA^3ili:{ic:O^ffOS^tKttK53b^*5 0 20 ^J«HSJiX«33-3 (b~d) ^Jf^TfXrA 

[0 2 3 3] H4 3tter**^A^*>^ffll*fT4 f3-^2 5 6K&oX%£Zfts Mt*t^~?2 7 

a^ilOffiO^M^^fo isZTmrSZ^ttn 0K«*&?n5 D llOT^Xttlix?l-x3-£'2 7 Ort 

y*S*2 5 3tt->*rArV/l/^7U*tf2 5 4lCj; fcRtf5ftfe v i d_ t i m e 2 7 3 fc^Sft 

^^255 K&gsna «t 5 tsiJHWfc^^nn, mmm^mm^-rnxm^ti^mm 

9 0kHzT*ifiP3n5 o *D«y ?S*p©fl2©:3 1'- Sfcfefcffll^StU * UTlCf 7.rA©B#flM£ffl 

14, er*r3-^2 7 0OrtflItft0 9 0kHz-eii l^M. 

MZft%z-(L^y$2 5 8fciRi^cii*i&sn, f 33-3: 

*rAr3-*f2 5 6rt©*>rA**V*2 5 5fcllJH a) ^ffl^ffl= (tfr^AX^yy-fXrABf^) 

^sns. 30 b) mm= a-^r&mm) 

[0 2 3 4] tTtWAX^^Ii, ATJtrtf- c) (X-tr^l) = {£7**4 k**y? 

£ t lH-l/cttSSSn?) <fc 5 ti/7.rArv;l/f-7V -f XrABf 

£^2 5 4fr^ftl^^77r2 7 l*^LTSKn d) X= (Hr**>T AX* yJ-Z/7>T ABf^+Vfr 

5 0 W*WiX?^lief*f3-^Z 7 0©^ *®^Rflffl) 

-^2 7 oortwo^Aa^v* 2 5 8cDB#pionb o jE?n^i^)B«FKf±, s^ftsftfciRfttf^jasfxaji 

v-rn^^tens^s^ij-rao r'3-^2 7 o©ftWcisw-?>ft/iv i d_t i me* 

[0 2 3 5] E4 3£*Lfc^JS0!l«\ ->XrAfn- 40 2 7 3£fr$tt5ertf£€l$BfcJitBSft, * 

9 0 0 0 OMfrf 3©"C, LTMtf XrA©I^|5lffl£fflV^tl3„ B^UE 

r3-^f *rAfl$B*E8*£^t34M£i$# lff*f3-?2 7 0©flfil!l£i3W-5ftfcv i d_ 

t*. i^T, ^XTAHfKt±±T*SWtt:^rn t i m e*£^* 2 7 3££$ft5V£T*«^8ffHfr5 

-?£*$Wfc:$*&£nSj&gtf&5o fXrAEfP^ SH$ftf#3o ±!2Lfc#fgflj^ffim^l«F ! 3X£ 

©^ST^I-^clt/b^tSo 50 [0 2 3 8] *f§Bj§Cfelj-§ffi©^»^%3 3lf7 
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-^2 7 OT* 1 6 tfy F£SB C fc*Rr*KfSft«>* 
7>*£ 1 6 e-y bCHltSo -JlT?tt 1 6 -tf-y Mi 

90kHz (tfflsns^t 2/3fMW 

a 7 1- F*R#H£ /StlBiTfe S "PSS ©"P*© ± 5 
TGl±gfi£llfffS:b\ xt±«^k?na^tMPE 10 
&£n§©T«) . ±^t> ^ft«^Ax*y7xii7° 

WVt->3> (H*) B»&i^L&l\ 
[0 2 3 9] 14 4Rtf0 4 5£SLfc<fc5£, I^WI 
HXtter*r3-^2 7 0ft©V i d_t i me#7 
>^2 7 3ttl 6tJyh^lJ-%ffl^T^S. Cttfct20 
<07r**t«kt)THn!6tSti5. Sfc1\ ->Xfi^ 

S3 - 3 *#Sg) i:<0H©MS{±«t/hS < ftS^fe 
£9, *ftfcJ:»>*±ttt£y FOKi«fc4S. £ 20 

CfctfT**£tf--eS5. iot, «T&e'7 Mi^g 

[0 2 4 0] fot, *^WCfflV^ft3Rf|gfif$B© 1 
6l?yH4ftl80fts (7f FJf IBOft 1 %) © 

tSCfctfTtS,, PALXttSECAMMOH-n 
«;^©6 2 5 5^X0x^3 yyXrA«5 6 2 5 
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HzO^n'^Cl 12. 5f^^(ticks)T?S 
NTSC75"S©5 2 57-fyOfl/^3/>Xf 
At±9 3. 8 4f-fm«. ioT, 16H'yF£ffl 
V^S d fc l±7 W FBfPsM 1 %<Dft&.T?*'( ^ ^ ? 

[0 2 4 l] 0 4 6«M-K7x7%/rbT^^A7^ 

ttffl6^T**o ^~ F7x7& ZOOtfa-^ 

mx^ts b-^ys YNC_T IME££jjET3!H 
Cfc-pTfetK dtliillL/cP I CTURE_STA 
RTF-^>©Mtfat§ D MPEG i/Xr AX MJ — 

3M£ft, r-*Wv brt©l§ l oWico^TSfo 
*©;^y Fttl?T*T-*t££l£oTl^©T% 
-ttc, ^AX£y7tf*LTt^{ft©F^©M 

[0 2 4 2] ^«K'»$g&v^n7n-try^>* 
-7x-X^LTXah-^>%ffl^T*^OHffl 

flic*^T#*&sns «fc 5 k LtfefiiA, i^f n©*i& 

(16l£yF) tt (72-feX*£/<l'MH4fc:S'£Sfc 
46fC 2 O0»^{C^tlJ$ tlfc) ra^BfH 1^7 X * fcfilSf 

[0 2 4 3] 
SI 2] 



WHfW 8 — 1 7 2 6 2 4 





IMX/Dir 




IS W 


ta_low 


8/rw 




ts.lowU x# Ji£lSJffl*iji*4llc»»*4^ 
«tolc?£JgS6ffr5 (-5-ili±SYNC_T I ME h 
ts_IowPi?X^-^£D*#iA*{i-7X^b^X^lC 


tsJiigh 


8/rw 






ts_valid 


1/rv 


0 


CCDtTv Hits.lDW&tftsJiigh Ovx^-Xb- 
fS^ts lovts high t\t r <t i£ r ?'{ 9 o 

iT*5 0 dffljSJC^i^Tts.low&CJ: tsjiighic® 
Mt-wiA<T-^) , ts.vaitingli 1 Ic-tr »/ h£ttS. 



ts-vaiting 



1/ro 



azmmsmzttt* sync_time^- 

9>\Vk<D? 1 CTURE.START b-?>V> 
IftKfi^&l'U ts.waitingaOlcttS. 

Sl3llc^£fcl6{c ts_valid folzl&gf-offiizZfL 

& o -e* * c i st^!c-r s tz #> \zm £>n* *< 

So 



fcfSfflfcfc^T, 77^"t s_wa i t i ngli, W** 

iMEh-^y*ffl^Tfla&*nfc!a:5fcf, ^©h-^ 

[0244] P I CTURE_S TART b-*>tfffi 

fftift<, P I CTURE_S TART r— 

StffclfflTftStfcfc^U YNC_T I ME 

b-^VttP I CTURE_STARTh-^y©M® 



[0 2 4 5] H4 0ESLfeJ:5E3l2©€$?:i-Mt 
2 7 kHz©*Pv*T?I&ft*3lMSiS6S8 
-7) ^ ^^n7n-77V«l7->y (MS 
M) 2 1 8 fciSft2ti3*fyI$fi^2 7 8ia5^n-> 
{r-&hfflrs v i d_t lme*fV*iiP6ft5. El 
4 4fttfH4 6fc^LfeJ:3lc* 4 800^^*0 

V^x.tna\ 4 8 0 0ttl'6%3 0 0 (2 7MHz/ 
9 0kHz) fg-pfcSo H4 5RtfH4 6E*;Sftfc4 
8 0 4. 8 ©*7-> a yttWTtito 
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[0 2 4 6] NTSC£S0*7"fl'£5?3>K:*V> 
T, 7U-i»l/-htt3 0Hz-?»l4ft<, HBtttBff 
2 9. 9 4Hz GE5tfcfcJ:3 0 0 0 0/1 0 0 1 Hz) 
•e£3o [*5-rHf5>a ^OtHSMfcttlESlE 3 0 

^>^^Af±7U-AI^W0 1/5 2 5-P26S) Sfet) 
^ny^SSattiESttl 7 1 6. 27MHzfJ2 0 * 
Ifbf^H >S^fflf*(i#*3 OH z (HDTVTtt 
6 0HzJJLh) EMSd^tj|5(c*^LT^So ^©fi 
III, MPEG&IE5ift3 0Hz©7b-Ab-r-£^ 10 

(v^y^ftD 1 7 1 4. 2 9-1M'i';I>TSS) *»5 
SSLfc 3 0 H z ©tH^v'h >{f^*^£T S C ii f± 
T'tft^©T% MPEG(D7l/-AMt30HzO7 

[0247] \-Dommmmm±s 2 7mhz©^ 

P7^£f§£T3ftfc>!?k: 2 7. 0 2 7MHz©^P7 
* S J: 5 fc r n - $Tr? * a 7 * b- b *mt 

(bend) £T«&3 0 C<D^n-^li9 0H 

zOdmy^fc&jStSfcfcMPEGO^ay^Sllifc 20 
ffll/^T (3 0 0«fc!3trL?) 3 0 0. 3 <D^JggT^ 
£©27. 0 2 7MHz^7^t 27MH 
zfr52 9. 9 4Hz©7b-Ab-h%4^.l)|Hl^© 
l£f* > ?I1BS© * n 7 *fjft tflESIft 3 0 H z 

[0 2 4 8] *fgltfcnt§7U-MMtfe^Ttt, 
9 0kHzfcfcl 6©Hft£7 7^cj;oTllfuliS2 
tl§ 0 i-^T, 3 0 0. 3 X 1 6 = 4 8 0 4. 
2 7. 0 2 7MHzO^Dy^O4MWTft*a v i d_ 
t i me *7>* 2 7 3 (±!Hb7c) &HrW§HfH 30 

*tupsg§2 7 smmmimcMtmian 

hUZftZo ZVv i d_t ime*^>*2 7 3«y-fe 

[0249] ^mic&rtzmmm^JkVv i d_t 

7V 77^-1^7 7 (resistive-feed 
back) X«7-('-^7'C-K^7^ (we a k-f 
e e d b a c k) «fc U fc a S£ (c o r r u p t i 
o n) £HEftt3£±ft^7^iW©7^-F^7 
^7U7 77Ci7 7T^il-rStt^-et§o USB** 40 
y^fflC^n7^K#07^-K^7^7U 7^707 

[0250] E47 MSM21 8 ^ S Y N C T I 

ME h-*>*A*Lfcfc*fTft3JBa*^bTl^5. 
MSM2 1 8«eTtfftlS#9:/*fc<fc^T^Sn5£ 
fiEOI^IUISMliWRO, ^LT^nttTr^S YNC_T 



^¥8- 1 7 2 6 2 4 
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I ME h- *v£«fcoT^Sft5ffifcfcJiR-r3c:i: 

HfcJtRufc J: 5 IM©B#P^¥^»^£?J&J 

[0 2 5 1] SfSHEfcl^m 16^7 r-ft^l©^ 
A7^y7©IIIEffiii, er*SYNC_TIMEb- 

IIEfiaf-77U-b7 r-fCTM S M 2 1 8K±oT0K 

4V^S5». $iJffllv^^D7n-b7^a^flf^^iE 
tZtzMZ t s_c 0 r r e c t i o n©^tfl^t 

[0252] v i d_t i me;*J9>£ 2 7 3\HKt% 

(tL$445if, MSM2 1 8t±-3T384tnSx 
v-n-K^rt^ ) ^©PIM©«*Wi:5tu 

Sfr fcWB'J-r 5 rc * t Hffl t ftSo *<d% g «flg 

frb 7 U-ARH47 7XX(iv^ t X tfr 
^^-rsy^fWffll-SCfc^tSOT (VTG 3 3 
3tfS&lC|(lftLTV>5®T?) , ^©HfflaiO©7b 
-ABfHtT-t?7 b^niio 
[0 2 5 3] *©Rgtf7U-X»BflH*H*fcft5fcf, 
ITIEfl>W$2nfttf ntefft 5ft^ 0 *§§1©M S M 2 

1 8tti«ftBfKSTil^^ffi^tiE$^§iit^-e 

t5©T, II^fb*^t^ft5a'MSM2 1 8tt*© 

5, s-stfM^©^^ omnx^^Kitn^it 

© tH*-P8W»*«BfeJc BBSf S <: T 
tft^©u\ ufHirieiiiu^ **a^©^-7->7 

«©£aT?a*f {tfflS£ggM&T 5 C i: -eSfeSo C © 

aia^gafc-rsrcfectt, Mftx^-hn-Fxa 
flush h-^^tsitfk^nss T^TOr-^* 

HSSf 5*5CMSM2 1 8©EMU^***7W7 

A-rscifc-ea&a. mc, 17- rE r r t 0 o_e 

ARLYJ (id i s ab 1 e _ t o o_e a r 1 y©fS 

V\ ft-tfftS, X^-h77 7©^ ®l©Wfitt¥< 

[0 2 5 4] Si 3ttMSM2 1 8 <Dl/V7>91fi)L<D& 

tfi7-^ 7-t-v>'1ffE©f¥ll^bTV^o 
[0 2 5 5] 
[Hi 3] 



(42) GH¥8- 1 7 2 6 2 4 

81 82 









1% W 


tsLCorrection 


16/rw 


•fcTn 




fraae_ti«e 


16/rn 


22B or m 


m>i-o PAL/NTS CiC*oT^J6& 
ftfctt»KU-fc» r1-5. 


vid_tine 


lB/ro 


"tro 


reset XfiMset.tiBefDV^tiJWcioT 


■anuaLstartup 


1/rw 




de dlsablfr&ffl^TiiWKftiS^nSii. 
T'*5 0 -©Ji^lC. MSMTTiiSEQir 
ENCE_ENDXtfFLUSHI--?V 
iidecode_disable*ll^-trv L 


decode-disablB 


1/rv 


-trn 


Sft»fflB3te8#i;M S MiidBcoda.disab 
K*i74<tE<T) . manual-startup*U 


disabla.tDo_ 
eary 


1/rw 


■fn 


l<v.©-fc.y ^i;j±^ii¥©Jg^l:^-r 

X5- rERR_TOO_jE ARL YJ ii 


NTSC-20 


1/rw 




1-v.ro-tr.y |-B$lcf±$fji5ie*SfcUB00J:») 
tfL64B04.BK**):5WW-*. 30Hz© 

■y KStiS. 
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discard_i f_ 
late 



1/rw 



Cftli TERR-TOO^LATEJ im 

5) o lK-tr-y h*tl*tt$tf* discard- 
until fcA-jTwitiattJSil^-^tt 



J^-fbS-Mft&S tirfc * -f A * > 7*£&7 

O-FLUDH 

1- SEQ IUENCE-START 

2- GROUP-START 

3- NEXTP I CTURE 

®^f*i LTdiscard-until t5< TN e x t 
P i c t u r ej c*v h*ft**<, 

/ s - y * ->v K#*fes ft* i 



^©l*H*4Rltgi:*So E R R T 0 0_E A R L Y 

^<cjetTv^545ff, err_too 

_EARLY{iSPffl;*tt5tf, E R R_T 0 0_L A T 30 
[0 2 5 6] StfttCfe^T, £*BfH*i* 

rr^-fAx^y:/^ n i o@Krt©^r ab# is 

MfttS^n-yi'Pi:, lg 1 <D0ESrt<DyXrA 

^y^t^Lrnmmm^tio, i/7.Tk%m<Dn 
-*/V3tf-*8£#U ^A**^:/*:!! 2 ISIS** 40 

X T AB# RMSIH kl" §^D^Ift, ->XTi,T3 

- r AB#r^«»-r § * n 7 ^» t com 
tttm\%im^y$t, ?(D%immvy$tm 

tfeftfn-^feo^tt), ^XtARSISOd- 50 



-^XrAB#P^©B©g^^y?X7-%$£ 
tSglffcfifcT^S. ^©ffiO^MiJa, SHI CUB 
^■>Xr ARf HfcSMfc? 5 * a 7 *S$£ffl^T!& 
i©@SStf^2 0HlK©lRlS8%i:5Sll!&«^, Si 
@&(4^XTAR#HfcS81-5fci&©2n y tgmtQ 

im^tmm^y^^L, m**yy-mwt 

^tttztbicm 1 OHSSrtfcS 1 h U -A£^ A 
A^V^^ty. SlcOHSStt^^AX^y^A^f 
5«fc5ES^?n, ffl©@2§&S#XHJ-AB#fgt 

AH»n-£;l/3t°-£ij.^ froE3|«^g*X 

b «J-ARflS©n-;&;l/=i ¥-t*\mt%Z. £K £ <3 

•>Xr ABf Pe§ £^ AX* (Dm$4 5 >^iv 

-*J*£-T5S 1 h U-Alflig** VERBAL 

/c^2S*XhU-APfH*^y^%^1-5o 

C , S¥€^ tt * f 5 > ?x 5 - § fc 

mam 1 O0KrtO^rA^M*MkfS^D7 
*#P4WLlVS. S 1 OHSSttS/XrABfPl^ffif 
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rmnn^^n \ ^Ttmrs^yy^tmbx 
ywmLi/ZT-mmmmz c £ t «t mm 

i^HSl t er^I^Bf fflon-*;!/ 
n 1 *Jt«f S c £ <fc 0 ->Xr ABf B5 If Z 

er*B#H* 7 l^ffl bfeS 2 £t*I$H* 7 10 

zj^yvmm^mz^ z<r>24L7>*y 

m&iEftvy'zzfaim%-£tiz>t\%%ZJi>z$y 
7^***fc»fcffl^5ft577?iHM.S. 
*>fAX*:/7WT*T-2Xby-Afr5ffi»>£5 20 

t K J: o X^%^4 AX * > Tit «tf b^X # KfSH ft 
% h^ft* Wfflf § fe* l^X * C«MtJ, =fr 

a^Ax?y7tlB#vyx*rtK#im§&p>ff* 
^©^Ax^yy^r-^xbu-AWci^n^o 

ffl©^Wtt±ELfeJ:3K:, S*X b U-AB#fS*7 

ELfe«k5K:, S*7,hU-Ar3-^iciStt^n/c 30 
|52S*X b 'J-iBfflij')^^ 1 6 tfy bKHS£ 

JWWig** b U-Arn-^WtiPT -l>fc46tc l 6 
5M8*Wr5o ^ftliHfcSJ&SfcfiV, £-fAX£ 

yyv-zytf*zftT^zfr&fr*mmu 
Lzzyyh~ty*eT*T-zttmt%fctbicb 

# LTJtssftfc t iziamLrdm$-( 5 ypx?- 

tf^ £ titc 1 1 OffS/ <7 * - * E * 5 §fr tfWSJ 

2 tu *■ o jte l rcffl^S' ^ * - # tw£ & % 1 1 
%jato iwmm&uyT.T hf^-ft eftfn- 

E G^XrAX b 1) -AR tf t*t~* 

ox b y-Afr£©er**^Ax*y7fc£gWy\ft 

3«fc3K*£Sft5o ^D'>XfAr3-?li->XfA 
«flH*^-rSI 1 I^IH*^>**#r4. Hr^rn-^ 
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SU-hT^OliT^r-^Ul^U tfx^fAX* 

* f- *ftt> vmmmt 5 tf t* fa- ^ s n 
ft Wi© ft & © e £ A X # > 7^M*a^B#rs 

HE&KS'XtAISH (S Y) , *4KK*y~J (T 
S) Rt>*S*XbU-A^ (ET) ?:-#x.3i:ttc}; 
t)3gi0HIKfcS2 0|HlKi;©H0l^Kx7-*S£ 
U S*Xb'J-A^ (ET) , ^^AX^>7 (T 
S) Rtff*rAB*IH (SY) ftM^«CfcK«kt)TBI 

n^n (x) ^f#T, sx=et+ts-syksi:t 

^2O0KC^B#ri (X) Kii^fflLfcl*X 
h'J-A^^A (E T 2) ^f§4U HIfl3Lfel*IB*ffl 

or, ^2O0K(c^xxAB#r^ffi^-r3i:t*<, 
Set 2— xtjSiiTH 1 <D®mt% 2 ^ffi L 

(TS) RtfMBfK (IT) ^^Ax^y7 
(TS) Rtfffl^H (IT) W^Ltiaoffi 
(X) ^f#T, SX = TS-1KJS UTS 2011 

Bicftjflisn (x) ^#x.sfcittiiiffibfca*xhu 

-A^M (ET) «84U RBHiLfc^IBI (X) *ffll*"> 
TSET-XCfSUTB#P^X7-%t#5o Z<D£o^ 

i:ft<, S2©0SSC^b/c3fP^fi:1-§i:i:A s Tf 
3o St, Sl©@SSi:S2<D0Kt©P^©BfP^xv- 
%!*Sf3fto^a^©Xr-y7°^bTV^ 0 tft 

b*>. mi<D®m^>*TLm (sy) , fftw 

AX^y7 (VTS) St/lfr^I^BfP^ (VT) %4 
er^a^l^H (VT) , 

(VTS) Rt/s/XrAi^ia (SY) %fflv^5<:i:K:«t 
qTP^IWP^ (X) mx, SX = VT + VTS-SY 
KSUTS2©Hl^Pffl^H (X) tttttnm 

l^SSrtCtfrWfBfP^ (VT) t^SJL/c^20 
0Krt©er*a^H (V T 2) £%£U ^fflb/c 
^ (X) *ffl^O^VT2-XK^i;T^SIX7- 
^#3o ±^T, SlOllKtt, S2(D0gStyXrA 

[0 2 5 7] fflmM y#x<y 7 7 U y^ico^t?) 
imm^y^^yyT^y^-o^x^mn^^x 
asn, fltfir{4fg*iti«n5o ^nt±, matg 
ou-bcBiiS8**sAV -STi±maou-b*a 
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SOU'V ^77 bT V> 5 £ t ft e 
7 F £n^M01®©2o©M-£[^ 

[0 2 5 8] 1 •OOfflffllll&tt (Bc&fflbXMtJA 
#) &^7 7 r ^©7 *-feX*»7 Lfe t *#3Bfittftl 

•ooffilfflHiiKft^-o^7 7r*ffli/^S<:i:*lt*S4 10 

tfX^y^It^^T'flit^o 77>^DflL ffi 
<DXV7 7 HT?#af 3 r A tt n~<0* 7 7 7 , CI 

OttftV^OTfT^-fe^l"*. 20 
[0 2 5 9] %.%W<D~$mW\fc]8^Tli, 7*4V9* 

7 7 rtiffifflllfc: <fc o T7 *-fe*SftT^*^y 7 rtw 
SLfc£T©fi*§, tftbS'f *-7>*Ma-7\ 7 

cD«fi!ctt2o<0M«y7rHK*5i/^T^ao€^^IS 
3|-r*^»olRW*ffiffl-r*{:i:*^LTi/^S. loo 

«^o*(c2 0(dr AM*e^*n*ci:tt-'Wisas'r 
s^o cmmmm<D%i(omM<DTj7>tv- 30 

hRAM05^0 10tD2{gd-tr;MT ; &#C3'c bfrbft 
#5, H 2 OSSEiffJttr ^ X * U - F^7 7 7 fco^T 
oiS^ffi b&tf»t i&^iaiffi bTX^RlTiat T 

i/^©T'2o©^©e7 b7-r>*»feati-ntfa54 

V. 7^-tXA^Or^X^U-bR AMfflfcH-O* 

§ mz*y7 7frt> *n-e*n h tig* s m e 

tt®frti^#tiJb7 FVXESSRSttfc 1 <DftT3—sr 40 
St>'»tJA*7 FUXtJSIfrSftfc 1 Ofrxn-^KJ: 

*-WatTxn-^tj;oT7^^X^nfcMtO^T 
ij^jEtfti^ J; 5 KP-Oi^HCRI-C^'y 7 7 
bT7£-t:7sb&V\, 

[0 2 6 0] &fiT3~?tf&^v7 7frt>ft*7Z*. 

7 7#^tc^sft^n, ±ELfcra-©aAofe»*n so 
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6 y^'az 7 h Hi R AM 1 2 fttf 1 4 

7 7 1 &RAM 1 2&tf 1 4rtOXttJ^6Or-**lli0 

@SSSt;»JASiJil0SSttX F n-7\ r-*Ktf 7 F U 
^S0fl7'f'>8OffifflJc«t»3C:n%lfigbT^5o 7^ 
y 7 Rtf 9 &9&imm&fc J; D 2 ti£ R A M&tf 

istttiSijffliiiiKE<tt)ffiffl*nsRAM*^'rfe*offlffli 
v>r y-eh^o v4 y 7 aftAM^smoffliT^ <t 5 

tffitgU 0M*Jf, ggmSUfflHHS&^R AM 1 2£ffl^3 
RAMI 4*83^5 fctiftU'Wc* 

5fc«£U «M\ «A»«§tfRAMl 2*ffl^ 
SkSfiU^K RAMI 4%ffl^5k*SfU^I'K:ft 

[0 2 6 1] 7s^y^^777(i20 
ORAM7Wl2Rtfl4 4tr*, X^>^7 7 
7 1 Ott> gil£**y©fcjl7*'feX£iBg&><VF 

RAMI 2Rtf 1 A\rmm*ZMttZ> a tftb 
■6, »t&&7FbXl 6, tt*ffll/7Fl/^l 8^ r 
-^A7J2 0, r-^tti7J2 2, R*WLRtf»ta* 
TOt€ TOW T*5o H4 9fe#HHOCfc. 
[0 2 6 2] #tJA*7K^Xfttf^*tHb7FU*M 

^ttv;i/^7u^-9-2 4fc«t^T^afk*nSo ram 

1 2Rtf 1 4im*<D-ty7slC35^ZW&®$, tTT3 

Wc*5V^T7s^y^ i !7 77 1 OBfflfflMKtt, R 
AM12tt, WM^jAnMl^ R A M 1 4 fC^O 

[0 2 6 3] RAM7W 1 2tt»tiASn§^, 

CO^HIOH, RAM7W 1 4li*fiASn5o 
RAM7U^ti^tH7l/-< MfflIXtt*ji7 b-Y »®7t; 

ttib»@SS4^l 2f©RAM7W*7*«U 

mr^mmzm-<D-RAU7u-{ 1 2^7^* 

[0 2 6 4] ctoT, *%ltfe^Ttt, 20©$ip7 

^y vm^n^o w^mm^mmmmm 

aft5RAMKZ>fy^jSbT^5i:tRAMA^Sfi 

sK-rsniBoWfflrFcftv^o-e^naRAM 

%S-6lc7^-bXbS&«)5ft\ XattSbte&So $gfb 
oifflK: ttv^-f n©^7 7 7 fcKfctHt fe»E5»ft 
t©tt*t/^OT'SE*tiibiJtt»tjA*{ll*#KS'r3o 
[0 2 6 5] *^0^2 0^SSe!lt±H5 OES^tlT 
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V5. VfeMyfrtyyTS 0I4RAM71H' 1 4 t 
l6£SnfcRAM7Wl 2©tl!!1MX£*rr3RA 
M7Ul , 3 2£Str 0 tV^Wffttf, £lfttf&20 
*»M7^fc^T^-©R AMOltfSStf, fg2© 

[0 2 6 6] *fgHJcD^2^MJtfc'^T, «A|H&g 

ffli/^nsfeotras-efeSo LfrL&#5, ^n?>© 10 

2**£A/T?^S„ Mffi7^-bXffr3-^3 
8 W 2 ■fe^fifrn-^ 4 0liW>^777 

[0 2 6 7] H5it^tJ;5^ *m£.mzm-£ 

7^ yfft^y 7 7 3 0 ©#£<Dffi^i§«1^2ftT 
l/^o {0^©-fe;b4 2«ff 4 4£tSM„ SttftfTT^ 
-**3 8Rtf»JifTrn-^4 0fi^KTfT4 4*7^ 20 
tXt5. lSOfrttTFU^-l'yi 6fttfl 8EJ: 

7^5 2&tf*&^y777l'> 5 4l4SOfT4 2© 
5-B010*aR-rSfc»OS«Itll«*^*5. >V?7 
70 t: 7 r-5^>4 8Stf^7 7r 1 tTy h5^>5 0 

4 Rtf 3 6 KSSteftT^*. 7 F UXfg£<DH^<:fc 

^tiifk©ftJ4t, rafswtt^v 77 ocomTt-t 

777 1 Ofr*7* , bXf5fiifi73-^4 0^b 30 

[0 2 6 8] StA^LT, *5§H3ti, '>S<fcfc20 
©RAM7U^, RAM7U-Trt'NOr-^7Jj*M 
8t5ftftRAM7Wt i: § »i&fflfflHHE& 

t, RAM7WF«3^507 i -*ai7J%MIB"rSfc*R 

a M7 w t (Dimzt mmmmt 

y?;^7 7'm*m^T^% 0 Mfc, tiAWHSg 

stf^ai r a M7 u^mmLrcum^m 
\zt^>r^\zs.^\z\m^t^o My?*-?? 

7gS«RAM7W^ l*K)tf7 hv-tyZftLX 40 
RAM7l^©{51£t3«A»@S&^ fB<D IS* 

i±ifiijffl]@iEgt, ffl^o-fe^^^w^ftsiaicijto 

It£/t LT R A M£7 ^■b^ , T«l!tWfT3-^tf» 

a ofrfcs^-r § t 3 - ^ffl 1 \ 7 * * 7. s ns 

ff©^<Dl£SKU ^HM&tmMEgfcg^ 
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[0 2 6 9] Er^'[f^©fS'ItO^T©*^©l¥l 
tJr*#3l (decompression) yj^Thlt 

mmmmLfr-Dmtz 3ooa*^^ty 0 

^OH'-7^#a>'7rA0 3 0cD±^gP^(iSH (sp 
a t i a 1 ) -Rf ( t e m p o r a 1 ) r 

Er*7t--?7^tl:*5„ *fgE^«-af 
r3-?*t t'ft7*-V7^ 1 ?©-B|f3-? 
R If r* 7 * -V 7 * A^tl^ftOWff ' S y 7 7 (&. 
T 7 U- AfE'I^ 7 7 7 ) fctSt %mt ^T'l^ 
MPEG^fAt^T, -^fT3-^{±2 00 
7U-A!E'iA7 7 7£#^ er*7*-V'V^fi2 
OO 7 b- 24EH A 7 7 7 fcSA/P^S o 
[0 2 7 0] MPEGf±3 00l45aSOR«*^ffl 
T^o T*fc^ -Ob? :intra(I),«|: 
Predicted (P) , 2X7Jft» : B i d i r e 
ctionally interpolated (B) 

£9, xnmm^m^h'o, \ 

So IH5^tOV^T{i-R#T3-^tj;oTl*§^ 
{fcO&BttfcV^ P Rtf B Rftoa^fblc fc^TtlO 
ffiffl©fc&20©7U-AfEt^777©5'5<D 1 

tEits n* w-ntf & w\ p uMRoa^kawKHc* 
n/c p p m b BHSfcssft* § Pit 

ffiffl1-5/ci6t7b-AfB , i^7 7 7fcE**n*. B 
Wftttffitf® 7 AiEflSf ^777^5 5 Mt ZZ-tif' 
Tt5o UA^ft*^, BBWta7P-Af3'1^7 77 

[o 2 7 l ] I RtfP iWW4*n*HI^{l:*nai:*- 
0 C, I RXf P Wff tt7 U-AfE1tA7 7 7 O 1 otl 

-^H: 2 0<D7 U-AE'1^7 7 7 A^tuOW«^ 
tiibTttm<DPXttI»^lSlltbTV^ 0 ioT, 

&z> t^m^m^rsr^-m^'o<D i p 
a s c £ # t? t s„ vmmm 

[0 2 7 2] «1 4C*Sn3£5£, Kff7b-Att 

#^iita^?nso 

[0 2 7 3] 

mi 4] 



mi 4 7U-AEH 



~Ltemz>im-?mmn%o ^7b?7b-A o 

7U-A) fr%o>%mm&ZZ.iLttM&T!ih% a i 

Lfc7l^-A (P7b-A) , P4A^^n3o 10 
t\ I 7U-AtP 4 7U-AfcOHta^?n^<t 
250^»L/c7b-A (B7U-A) #BeRtfB3 

/cB7b-A£ffj©7b-A (fuTJI^fJ) X(i**7b 
-A (H^Pffll) £#B§2tfS©T«&5o l£P4i:© 
H£S*2ft£^^T©B7U-A%£{fLfd£, P 
7 7U-Atf3£fi*ftS. P47b-AilP77 

fc^B 5&t/B6£ftJST3) *^i«nSo *LT, 

#© 1 7U-a 1 1 o<fiasii«nso p 7 t 1 20 

1 0t©P^;:S^2n?>' r <££T©B7b-A, B 8$. 
tfB97U-Atf3S£;Jft3o <!©Ht7b-AIi# 

^ 27 V-hm^mtU MUA&B7U-A&S 
*t«fcaE#0P7U-AXtt I 7U-A©jM#£# 
oiifcfcra-^lcBSL&^a ±Ef *i:«K3il 4 

OUfHftiHSTtt P&tf I Mj©ft7J«T-*X b U -A 
rtO*OPXB I W-^f^-^ cfcoTS^fb^ 30 

[0 2 7 4] P&tf I Bl^tflfSEJiJSttS tFJr£© b 
-77, -fftfr^P i c t u r e_S tart, Pic 
t u r e_T y p e, RZff e m p o r a 1 _R e f e 
renceli, ZQMWtm'^y 77t*f EStlS 

5n5o -Sfr3-^(7)til7Jl?a«f/c(ctI^fbLfcPX 
tt I Wt© DATAF^ 7 tfSv^ P Xti I BWftO D A 

ThY-9ytw&i<tu iht, znzittTty* 40 

-7"y*£S5ftS 0 -B#r3-£>?,©tii7J«b-7 
7{b£n/c^7 n 7a 7 7JM££tV 7* a 7 7fr 5 v 

[0 2 7 5] *^K©lfT*7*-V7^tt2"707U 
-AXb7 (f r ame stores) XttBMfcfcEtt 

7 u-ax h rmmm d fitfe 5 xbx*7 tys 

■?y$<Dt7i-y7° (off-chip) DRAMB3 
■0©7b-AXb7£M#t-§„ LLf03O07U- 50 



a 7 b7o«ffltt7b-At, mmt\iT*m3k*v 

[0 2 7 6] ^TO I, B&D : P7b-AiiHT^7* 
-v«y*©7U-A*h7£iEtSSft3o VOfe, r- 
*#Sa**nT^* C 54^5© 1 o©7 l^-AX b 
7, r-*tfS*&$ftTl^5 fc£ 3^4)1 -007 V- 
AXb7tf£»5, fit, 3O07b-A7b7%Wt 
3 e r * 7 * - V 7 7 £ tiffi© 7 U- A fg 3 © 7 
A7b7£fBH£ft3 0 

[0 2 7 7] ft*09ttm BiB^t/7D7 7^57 
X*"\©ffift*£TfTV\ MPEGSi20©7l'-AX 
b7*Wt3-Bfr3-7W2 0©7U-AXb7£ 
Wf*lfT*7*-Vy*, t&fct3£gPT*40©7b 

££3Tf3 l-0©7b-AXb7^l/-'5^t£<toT 
lJ5jt£ft3 0 $*0mi3O©7b-A 
7 b 7J£ttTer* 7 y *<0* 0 5S L&tfX* 7 

[0 2 7 8] *5SBttgl07U-A^h7EIUMfc* 

e«u ^2©7u-A7b7tPW^taii-r^o t* 

D97in677* ^©fflUfcfra 5 5 . B 7 U 

-abb 3 ©7 u-Ax b TK^r^tm^mm 

£»Ht±3lt^< B7l^-AA^-©^3©7U-A7 
b 7££frt § t C 5CfflV^n«. 
[0 2 7 9] B7U-Atf«*f<fcStl5fct, ^nBif 
1 ftl/H2©7U-A7 bTfcffi^S Z-DtDBSttC&mt 
?n/c I Xtt P 7 U-A^figf 5o S^fffcSftfc B 7 
l^-A{±ff3©7l^-A7b7£»tiA£ ft§ 0 $E#0« 
B 7 U- AX b 7^±£l/c?n§M£ * 

^©7X^t±, ^©B7b-A*' i fu©7b-A 
©«$T*7X2£<toT£tt5nfcX^-X£Si63/c 
&C^l-©7l>-AXb7£»t}ASn#§ c J;a£7b 

-ax b7*Wc$n^Mtr^n§ 0 

[0 2 8 0] 7U-AX b7©-SP^Wir-^T-a 

«> & tu *ffc & r- * -ez % tm*mt s ft 

tc, §7^AXb7B-b7^©tt^ffi^n? 1 o 
B^Cfc'V^TB, ^7b-AXb7B#^?^N-tr7^^?> 
4§2-7©7^-;bFXb7£5fcf^ll?n5o cc 
T% NB7-f-;bFrt©7*n775iJ©IScT^5o 7^- 
;UbWiilbT^{b^n/c7U-ABffimT£§ 0 # 
3 1 tit < v 7 a 7d 7 7^iJ{± l o©7 w -;b FX b 7rt 
K2O0tir^i5W. 7-Yb^77 (write 
back) tf7U-AT£-e-f-#£ltri:* ^X^Bft 
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L<Dy7 t&jcJtZ t> 3fc07l/-2»0§M&W 
* &4 ©tfSS©? 1 x *y ^ tt, 77^ A^fift t>ti5 -tr * * 

[0 2 8 1] 7U-AK«fcbTOff^fl:«tlfe7U- 
A{±ltElffi-e$5o 7^-;l/FHM>i:ttitoTH r- 
*©v*a7ay*m*tt5tfva*g*Sft5$£ 
tp-Oll#T-DRAMt*tiASn%l\ 7-f-;bF 10 
X h7«M?IJ£g.t&$ftS!b\ -*T1±^07^-;b 
Kttli£7**g*2*l3. 7^-;bFXh7=M 8 

*F70l4#*§0~7©8-fe**fr54D, *©#*« 
I7'n7^?ij%^& (tftfa^ ^©^©fiEJ^ft 
ff£ 81130 „ 7^-^FXh7 1«#^8~l 5©8 
■fe**fr5ftD, ?©&><?& i7ny^J£3t? CTft 

[0 2 8 2] %\<D-?>7U~7u«j tm*7 
70IC-fe**0rtlC7-fW*y*£tl, 7^-;l/FXh 20 
71C-b^*lrtK»ta*tl*a 7^-;bFXh7& 

4 FX h 7 0 ©7 X # 7 1' F * y Z Eil^Ofrft 
t/\fc5£aftSJrr^5j£T?fc5o LfrLfttf5* ®2 
©71/-AKOV^TttSl©7U-Ai:RI-0*}*T5 
>rh/^^t*ci:l4Tt4K *©-fe**{ig*5Mfi 

^msns©?, 7u-a©P£$&t 
Rtfis*ttitA^WK-et«:v^fc%jSi»r5o cm 30 

[0 2 8 3] j;^T, ^2©7lx-AiivX^(Cj;- 3 T 
gEE£fc&ofc7U-AXF7©-fe?*Kgti£$ft* 

Cfcti^T^frSnSo fct, 3!2©7U-AEft 
L T tt ¥ft © 7 ^ -;b F X F 7 © left tf£t> % o * * * 
4~7t±^2©74'-;l'FXF7©±SPiift5, 
8-1 H^l©7^-;bFXh7©T^t^ l 9, 

fc-s, ^n^fiAng^^nSo sio^nrnv^ 40 

Rtf 7 fc»£ii#tf&<„ XWUttZZ 2Rtf 8t» 
*&StU I l&tf 1 5ST^*ti&Sn5o c©/ 
t U ^©Bffl D 3 T tt^ F ^ y *ft tf * *iS«* 

[0 2 8 4] g3 0§lt«<B7l/-2>>tf*5&&& 
5^b^*IllSl07Wi»CR4. 4±W©B7U 
-A*F7fc*^T, FRAME (g 1 ) RftTtt : F 

I RSTW»B-fe?*0~8 [ftUWtufuyZfll 50 
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9, 2Rtfl0, 3Rtf 1 1, -7Rtf 1 5T*5 8 
[0 2 8 5] F IRSTMiliW^O^ ^LT, 

1, 2, 3, 4, 5, 6,7,8,9,10,11,1 

2, 13, 14, 1 5©KST?7X*^3nSo SEC 
OND (112) 7U-ili, -fe^O&tM, *LT> 
lRtf5. 2Rtf6, 3Rtf7, 8Rtfl2, 9Rtfl 

3, 10Rtfl4, 1 l&tfl 5£S*&£ft3o 

[0 2 8 6] SECOND7U-A«, -tr * * 0 5 * 
LT, 1, 2, 3, 8, 9, 1 0, 1 1, 4, 5, 6, 
7, 12, 13, 14, 1 5©JIT«vX#S^2n5o 

tmttzzoR.tf i ttt^sn-r, *ftttej§©fc 

o c c:ntt2o©as©rcftfi:sn5o sm, *U7 
(DkibK**$4 m-Dc m^-D t feiwi^©^ 

«T3->XTA©t^Klf£4*&^U Sfc, H 
?rf5c:i:{±!B»T?&3o 8 2 a, 2©3HM:^-fe7 

j-r a wfs+K xm * * u ©-t * * co^ 

Sftfcv (09*. & NTSC35fai47-r-;l/KSfc5 3 
0-fe^**WU *©*>-*>*{* 5 8 7U-Aftfc|| 

[0 2 8 7] *5BBEH-rS56n?**Bt), f!4©-fe 

t&tfn*^-r^f ^©ffig'N©*^ > o t, 

§^©7f-;l/FXF7ttF I F 0 k LTa*»K$ 

F I FOtt7^b^7 7Rtf7X^^^^Bjt^;:l- 
3o utltt^^©7^-;l/FXh7^F I F 0©i 5 

t io©^iqjtf£^»t^snii*tti^n§t^asni 

[0 2 8 8] ZtkbtLT, *mtel7\s~L,. P7 
b-A, B, 7U-A&tfB2 7U-A©JBT?er*ft 
IS^-x., $ 1 7L/-AX h7C I 7U-A£iE'!2 
•S, S2 7U-AXh7tP7l/-A%|B'i^^ 
<tfe2-0©^tUfig«£^»fJ?nTV^ffilRtf 
^2 7-f-;l/KXF7^-rS®3 7U-AXF7*^ 
x., S3^X?(CB 17U-A*e»^^ ^lXtt 
^ 2 7 Y F X h 7 © / 1 U M«©SS? L fcSP^^ 
5-B, 7b-A£lt*tBU B. 7l/-A*^*tH*n 
k c 5<d* =ev ffl$<DmiLrz&ftK B 2 7U-A© 
95^%« ta*t § C t K «fe o T E r^lf S^IH'lt § 

^s*a« <fc -d zwpz *fcio ^ t u % 

[0 2 8 9] OTKMv^Sna 20©7n^vAt±* 
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M7V^^fkRl^g^ (Hu f f man code 
d Variable Length Codes : V 
L C s ) &tf@£lffi^ (FixedLength C 

0 d e s : F L C s) mmtU WRU>;xi-fu9 
7V/;miYi'y (Mi croprogra mm a b 
le state machine:MSM) <D$fflO 

[0 2 9 0] *^dH»ijaMPEG-lM7V>^ 
^^rafil£MPEG-2feflM-rSo *^<0*ffiM© 10 

$£1/SU ^c^l|iJxaiW?$^^ 2 ©MP 
E G - 2S»«»r-7";b%fi!at5feJ&{C5nS„ 
[0 2 9 1] It, *^O^ffi«^g|33>hD-7 

5 (Escape-coded coefficien 
t s) , -fyh^DCfl (I n t r a-DC valu 
e s) RXfWjZ^Z YfrrfrZ (Motion V e c 
tordelta) *ti6©±Tttl6^LfcV 
LC/F LCjff#fcL/t*Hj-.krtK4*5ft*o 
[0 2 9 2] 05 2£#F,rr§^ M?(jA7vyr3- 

^3 oomm&R^ (v l c s ) zwmtSo f l c 

slif-^F Lck£^rf5A*7^-;l/££4$ 

*SfcafctfJ?j;!tti*-tU** 3 0 l 

Wfcg^fSo i^T, R0M3 0 2(±F LCft^ft© 30 

-£bi/*7.£ rMS R e gj fttf l~L S R e gj icftf 
^*iiSn5o £ftfr?>#fr££5t, ^ (ear 

1 i e r) J XttS±ffir-^ttMS R e gSCfEtl^ft 
5o *O-feU**ttR0MA*T*OVLCOjlfi**iJ 

7Y>?l§ROM3 0 2(«n§„ *WOK<VL 40 

mmmmtztiz>%%ic nff^ttt&v l c 

it, s^rscfctfTtsstt^tiMX (2 8tf7 
FOMPEG-ixxy-»SS) OfiSi:, i 

6 If 7 F-pfc5g*V L CUvfX (D C T^iSr-7 

[0 2 9 3] rr-7;l/J!S?J A*ttMPEGfc«koT 
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A77yjg§ROM 

S/7 * 3 0 1 1 <fc o T7 F b7ffi£MW2n§ ROM 
3 0 2t'$5. ROM3 0 2«VLCr-7>^lttS 
m ft 5 U m\tT-Z %4fi£t 3^3 Ifr 5 
r-^*#S ( i n d e x- t o-d a t a) Kfttf& 

[0 2 9 4] s&3lftiSH\ #*5nfcT-**£jff-T5 

(don" t care: r 1 J T 0 J OVvf ft"? 
fe&l^yh) J VyryVltGtZmTYlsZm. 
Rl^t'J (CAM) ©ft^f:LT%^5i:i:A^f 
5. iTOV L C^f-^HiSS^SSCP, CA 
M-ROMtt-H^-PSt), LM|5 4^L5 7ICi 
LfcROM AND-7U— V (p 1 a n e : ®) Oft 

0W777 7) ^a-pfTtenso-e, 4fSP© 

[0 2 9 5] ROM Or-T'U-Mi rpS5|j QSft 

(k l 7- h v << y) mmtT- zmmvyj x 

7-fx7^MtLT) WU 1MXfll«a-tr 

#fc*fT&3fe»EU^r-**T3-*R0M3 0 2 
[0 2 9 6] ^BHKfcVT, R0M3 0 207FU7 

iia^&ti5^t^7w^%ss?-r5. i^fttfn 
tfft^ft^tf 7 r-^-y&itfcS^v l c^cjifts 

LTft<, 1 6 If 7 VQtb^s r-7;HK©iiiP©4 
e-yh^*5 0 iot, £ff-T?2 0t'7 F®7FUX£ 
IB GB10 0E7FU*) tfil&Stf. ROM3 0 2rtK 

hfr7j If 7 F<D#ft<Dfc46T-$§„ 
[0 2 9 7] VLC s%^fbt5/ci6t(i, AND- 
7b-7^VLCH7 F/^-7rtO rF7F^7J 

*1 8 If 7 F«tt)gV^T(3DVLC s*», ^OVLCO 

*^St?*5. 7-rF7FUXOfcJ6AND-7U-7tt 
♦tufl^fk^n (2->4) , ROM3 0 2(ic©*M 

&ftl/\ HE, ^*MPEG^T-7;l/tiH^.T, 

r om 3 o 2 ttBfSow^r-^i/fflK^ft-ra^aa: 

V L C><*->*fffi!l*SArt*#f 5. 
[0 2 9 8] Wf^MTC^h 
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tvz^i&sm*), manma w ^y*> 

[0 2 9 9] x*fr-7>^fl«©e-*ffiSfll** 

MP EG- 1 T'2 8bTy hT*$5©T\ Cftli (2 8 J; 
D^fV^C^O^ffl^XTSS) 3 2H~7h©A* 10 

^;HB©!R»*#*« i tr 7 h©F L (:#*■©»«:«< 
VLCfrBftO, fl!ioiBtft"»*;l/ (fl!*.tf, at^ 

7h;k ^F^DCRtfx^-T^tffiS) 

«E©s$n§^5£E3bw, risj s/^i,-? 

(^IL/t^^l/T-) FLCtf*©W«:«<V 
L C t LXVffiiffi^fcZtU R OM 3 0 2 Eft^E'7 
h *a#ft**5 C t ©ttfc 5 ©SffitfR OME 2 O© 
*t£r-7;l/©^X£2fgET3C£T«£3&P>fcf 

ii-^ftMi)i*%a<s-r*cfcA^t*i^ bt, * 20 

[0 3 0 0] FLC5?lh-»y 

f l cffig©a*aF l coasftssT-feu****! 

fltSCfc, ROM 3 0 2%2lIILIE5fEj8#?L;fcF L 
«Sg&ftS!Ifc^- F 7 x 7 * < t a - ?'E J; -3 TE L 

t\ rn-^offlrtNBSfla&sfts. 30 
[0 3 0 1] Ms 

iKDfa^itfe^Tf 3-#£>Hfi5®^ Ofr©« 
S&Wf^S^o ^©H»i0 5 2E*irj;9E, * 
77£ 3 0 3S:tRrU7£3 0 iwai/^x^<DM 
tft^fROM H5 3©0tt37$##H©J: 

s [3 1 : 0] Rtf 1 s [3 1:0] SMMSReg 
StfLSRe g-pfey, ^D'^phselectM 
U7*?253„ *1>»o^f (IH!I9B) tt (8W 40 
&l©ni>'7 7 t ±tfc) 7d7^phselectlCt 
SfU *77h77?Hic n t [4 : 0] tmiEftT^ 

<n©l!§, F-77, (7n77ph c 0 pT'ff&frft 

[0 3 0 2] H5 4K^LfcHtt*»ffltBi:fe^7V 

y^R0M3 0 zs^s-rsfcaEJBi^ftfc*-*:/ 

O^E/h*ft09OROMlBH-*^bTV^. £©R0 
M3 0 2©#£©im±, Rr»N7Vy^*m^-r 



ffH¥8-l 7 2 6 2 4 
F^7J fflaAUND-7W>rtt^n/cili:T^ 

[0 3 0 3] H 5 5, H5 6StfE5 7, #EH5 5% 
S fc» r F y h ^7J «m*ff * 3 
ROM AND-7W7©fll©^ffi«^nT^ 
3„ COSfflfWEfe^m &7Fl/7^7 (a 

[3] , a [2] , a [1] , a [0] ) fct*OIE£lRl 

&tf$7ift©^E A n D-ywyffloTlK 
nso 4*5ftfc7Kux7f >±© ru xa roj 
*«^k-r a fc & h v > 7 t±se*©^rS-eiExttffi 

©7KbX7^7©Vvfftfr/\g^jft§ 0 TF>h^ 
7J (xEioT^tlS) *tS^kt5fc«)Eb7> 

y'z$te%(DiExim<D7-(y(D^fnKmffi-zm 

[0 3 0 4] 05 6 RlSm 5 7 (iljPtftn ^7 7 rt©« 

g®»&®-aM> f 7 v ^'7 * $ € § tc m 
ofllicfei>Ttt, 2o©7 Kuxe? FT'Sfc: 

t§4 0©nIt^#^0 : &^E'OV^T4-3©7-r>05 

^© l SWl^<;WcBI&*ftS <fc 5 WtWUfclc fcv^ 
T20©7FU7^7 H4«tlS^*h5o *ffiK«2 

;i>©*fu*g*f {MfitEiiff 1 5 z: fctt c OSHJOS* 

gEttBBSfrT'fcSo *fu^fbtfc^Ti±E^-7 
Stilt 2 0©7 F U7 e 7 F KHgC ( 1 Xtt (K 

SM^n^o |WI«E, *©7KUXlfyF©10*< TF 
>h^7j *^1-5ft6lf, F7>^77ttJ-XM©J;5 
LfrL%tft>, 7FU7se7h©-^ 
( 1 Xtt 0 ) % MS % >mfth 5 ffi/i © 7 F U 
7t"7F^ TF>F^7J *jMli:t*ft6tf, *WS 

#fb© 2o©7 Fbxv-ry©^-rn^^?Stt«iT'S 

HMIJKfc^T, Ctltt, : 0 0 1 xEOVTO* 
L «t 5 E IBSt § »HuS^k7 F U7 7 -f >© 
^^?±© 1 oc, M^iJE 20© F 7>i>7?rait? <: 
tK&iTmfcl£n%o 05 7E^n/c^SSMEfc^ 

Tt±, h 7 y vt, $ vwmmm^z z. t % < m l 

fdi^ffc»)c2ft5o il©tI^E, 20©^HLfdI 

a, M^osK^JSttft s tf7- f ?y ym\mm t 

fry- Yv^y F7^ ^^©N 0 R F m 

[0305] ±!3©iJB^{i, ^Hcrsm m, m 
%]$k<D±T*Ms % mm mis. Lms %cmc<D 



(51) 

99 

[0 3 0 6] CflD^ffOSiltKSbTOWltiafiO 

> W 7v f v flkSSIS L TEH* ft 3 2 fi-Y y * - 7 
fTOT P E G £9'yS-{mmRmW*ttS\£T* 10 
tS<#SL/cgS«rcfc fflfflb-^fttfDAT 

a h-^>a h^feit-aistfr-^sa 
-VKme>ft% 0 wmmmmimmtitcZT- 

LfeDATAb-^>*«ffl-f*±54^r-^*lf« 20 

[0307] *^©#££D^ia^?n^o^6n 
t & < ar c t t* * s c ti±ie© Ltfrzmwe 

mm. . . 

mm, . . 
m . . 

MfllX^-bn-F&tftfg (SCDP) . . . 40 
A7J F i f o. . . 

xfim. . . 

e~7 r-7£y7©E££. . . 
U— f -*-F. . • 

B*«ftftv^*-F=i-K. • • 
SSSfttfa-tf-r-*. . . 

WfXVK (P I CTURE-END) F-*> 50 



1$H¥ 8- 1 7 2 6 2 4 
100 

©ISA. . . 

7>\>y7-77*-V9?-* (S t op After 
picture) fJ^jA^. . . 
£JiH. . . 
7*-fe*e«yh ■ ■ 
SCDPtJ:0Hi*ti5b-^y. • • 
SCDP**'J-vy7\ . . 
»t. . . 

3-Hbr-^^777jg2©r-^7n- . . 

mm. . . 

A-F7X7. ■ • 

^-fAX^y7'«|g©MSMnyFUy^. . . 
X#-r-7y7°. . . 

3 0HzOW-h. . . 
**. ■ ■ 
tlv-». . . 
i>>>7°Rc>'n-;l/. . . 

>>>y77Fl^X. . . 

Vm~?isy<DT7,h. . . 

ym^yy-^tuftm. . . 
mm7. . . 

ALU. . . 

yiY7xi»j>?. . . 

*+y-7ny*. . . 

*ft7*ny*. . . 

A L U 37. . . 

ALU - V^Dft^fg. . . 

ALUO^ffl. . . 

• 77-OI/. . . 

77-01/7 KUXffiS. . . 
1/^^77^- ^772^7°. . • 
U-7X#77i';l'-7FUXVy7. . . 
b7'X#77^;l/- v^offi^fg. . . 
1—77*- K . . 
F-*y#-F *nff*tfg. . . 

UP I ^tU-WT'. . . 
**. • • 

-fy^-7i-7. . . 
«H©lffi£. . . 

Jfcfc . • 



101 

mom. . 
mc ■ . 

7b-A£S-j'<» . . 

7Y-;l'Fta-iK^SJ OV~mW\H) ... 10 
fa7;^7^A (7U-AHffirt) . . . 
7 — ;V FlliffirtO^M. . . 
7^-;VKtS^<^iJ. . . 

1 6X8MC. . . 

7-r^;bFHffii*iTa7;i'7°'7-YA. . . 
. . 

ff*. • • 

4 : 37y7-VyfVy9. ■ ■ 

3 : Z7^-^y"f^y9. ■ • 20 

2 : 17y7-Vy7Vy9. . . 
ijt^&ll. . • 

m^fr (pe 1) OR. . . 
ttWB*. • • 

mitr-t. . . 
ykmmsm. . . 
7y7°-^yy°vym. . . 

. ■ 

5 . . 30 

VTGffiS. 

mm. 
mm. 

U P I W. . . 40 

tH^v;b^7b7^7. . . 
MM 

CITE 5 8*#Sg-T5fc, ^Cta^rAO^tflt 

[0 3 0 8] COESHEIBSoa^OflMIW^ny^© 
P^£D-r^T©-Y>^-7x-7KO^TIE^ti»tb 
fcfc<En?&5o CtiKJ:!), &7'ny?tt, ^©7'n-y 50 



W8- 1 7 2 6 2 4 
102 

ftfflmzztffmft-£ft%'(y*-7x-z<07& 

*ny*36fiffi3 5 0, **-lo-Ft&tflS82 0 1, 
^-+T2 0 2, ^^D7o-t7^>^-7x-X 
(MP I) 3 2 0, ^^W^ - -77x2,3 5 2, 

Qrmmv? • 3 5 1 , ^m? • 2 

a^OyXrA^gp n n pOl©^y^-7x-7^S^ 

[0 3 0 9] X*-hn-K8ltfJ8 
II 5 9 ii *f» «t 5J/Xf AO@ggOffi©7n -y 7' t 
ffiSS^?nrcX^-ha-K«lfflffi2 0 1 (SCD) 
S^LT^So SCD2 0U±3OOSa5tlfi6*ffiffi 

i-atok^Aicfc^tfts. Ut, SCD201 

fcHMJOP i nXtiMP I 3 2 0fr&©r-**2frBl 
5A*0!8*aft-r5o S2t, SCD201ttr-* 
rtO^*-b3-K*tttHf5 0 »3E, SCDSA7J 
r-^^n-Kfbr-^^7 7 7 (CDB) 3 2 1 fit? 
ft W E ffiffl * n 5 7 * - V «y h K 7 -b V 7^;U 1 5 O t 

[0 3 10] rt-tf 

T^S. CDB 3 2 l©/cfeC7*-V7 bSnfer- 
£&7y^y72ft, MP I 3 2 0fr5liMM&$ltBlS 

[031 1] 

H6 i«s»a0Sg©«fi!cM%0SbTv^„ en 

E»a)l& n plC[il€f7- (Imodel) 325, 
$vW7*§§ ( I Z Z) 3 2 6&tfa»?{tS8 ( I q u 
ant) 3 2 7 atfifflSftolM ygSIS ( I D C T) 
3 2 8S^Stl*. f-^lilmod e 1 3 2 5 £9 
5, S6K I Z Z 3 2 6*, *V^TfI q u a n t 3 2 7 

$6t$/ci dct3 2 8*Sjfif5„ 

[0 3 12] rV77W0SS 
*HH^OxV 77^0^0 6 2£*2nTV5„ C 
©77xA«:gS7y7"-9-77^-2 1 0, 7jW7^r 
-;W • ^ri 3 3 1, tiJTJV/W^l^ 3 3 2 

ttJ»j;**-h=i-F*Wiffl (s c dp) 
#BlB£«fc3**-h3-KfctIi$2 0 1^ M*>J** 
-bn-FttltiS, EPS, r-^fcMfllKiEfi^Sfc 
®T?£§„ c.©77tA«, jfcfc 1994^3^240 
EtBBSftfe-f #U 7#If ttiltf5 9 4 0 5 9 1 4. 4 ^ 
fttf 1 9 9 2^6£3 0BfcfflK2n/cEPOffiSl9 
2 3 0 6 0 3 8. 8^, («T TB r o 1 1 yj fcftt 
5) tHS*tife*>Xri»i:ra«OfeO"P*5o UfrL 



F8- 1 7 2 6 2 4 



103 

<E£SftT^S. *»filc*V>Ttt, **-h3-F* 

[0 3 1 3] MPEG (lRtf2) X*-F3-F«7 
£-Fn-F ■ 7°U7JV>7Z (s t a r t_c o d e 
.prefix) fcl/tft]£)ft3e«y F^HJ-Atts 

TVS„ Z.<Drt*-y&2 3fflO-ifo©ftK 1 ^ 
Sfc©T&§ 0 Mstar t_c o d e_p r e f i 

(s t a r t_c o d e_v a 1 u e) £bTft]£>:h.T 

iSBHO S C D KSja-TSX*- F 3- FS?iJ£ 

AtfWTO-'W h ■ LT^S^nSo 
[0 3 14] 
0x00 
0x00 
0x0 1 
0 x b 8 

uft5tf?>-7°-X*--h3-F (gourp_s t 
art code) T&3o 
[0 3 15] A^F i f o 

*SWf*2 5 0 K/Wh/DO^-^f^l/-M0t 
A^StfAn ( i n_a c c e p t) gyfff IfR? 5* 



104 



i f o©gS£fi-gTS;fci&£«, i) x-cy^Ayy 
7<Dkib<Dmm<D^mm?st. 2) scd^il 

[0 3 16] *5SfiE±ntf, 3-F{fcr-**ny* 
U-h-«!Gtr*A*r-*lC»LT, SCDP&7* 

U-Afr^WFtfl&MlTl^) o 
0 A*0SS 

*»ffl©A*IUBl±B roll ytioTFKIlftt 

oro©@KoiHIEI±2, 3©l*4Hgtf#3El-5. 
Hit, up i{±h— J'yotaftx^F (*ftff-tey 

l^^o *-©ftfc!)£, ff^>- r—^> (i n_t 
0 k e n) tfn-KftiSTf^OiaiCf^Stl*. fg2 
IC, Ft ASPS© D A T A \y f \ y 

0 So 

[0 3 17] X#-F3-F 

*55WE*VTtt» MPEGX#-F3-F«SCD£ 

5 t^To 
[0 3 18] 
[Si 5] 







Plcture_start_code 


0x00 


si iee_start_code 


OxOOHOx a f 


reserved 


OxbO 


reserved 


Oxbl 


user_data_start_code 


0xb2 


sequence_s tar t_code 


0xb3 


sequence_e r r o r_cod e 


0xb4 


extensiorL_start_code 


0xb5 


reserved 


0xb6 


sequence__e n d_eode 


Ox b7 


group__start_code 


0xb8 



si 5 xf-t-zi-m 

\£y hX^y7(Dm 

— 0©s tart_code_prefi xlCftfrfS 
^j&vfta-ifrJlfy Ffc**y7 (fS&tt) 7*0, £± 
tPtSbffSo *^HJtfcV^T, 7^7 7©^^K 

[0 3 19] 0j*ff> &.TKW$-'U F • ry7£ 
0x20 //57#77-t?7F 



_c o d e_p r e f i 



0x00 //87^77 • My V 
0x00 
0x00 

0x01 // s 
•9"-^ ■ =£- F 

*5SWK:J:5"9--f - -t-F (searc h_mo d 
e) &WT©Sn 6t^StlT^5o 
[0 3 2 0] 
[Si 6] 







0 




1 


plot ure_st arts fctt*ttJy±©1f--*- 


2 


g r o u p_s t a r 1 3 ti-ttl£Lh© tf— f 


3 


sequencers t a r t £ fi-?-ftRJ:©-tf-- f- 



WP8-1 7 2 6 2 4 
106 



3116 *-f- 

-yn^fDMno^-^ • *-FT1;U£-F3-F© 
P/tH© * yZm-Dfr % S T'SJtl- 3 t — * 0£Ttf* 

h$tl, • (s t a r t_c o d 10 

e_s e a r c h) f!lt)&*tfSS£-rSo grU4UWe 
(s t op_on_s 
e a r c h) S CDA^SJ5j&* (COtliJ&SttSfc 

[0 3 2 1] *5SWC*^TI4, S CDtf FLUSH b 
e a r c h_mo d 
e*M?n£-try F2ftS«, LfrLfttfB, FLUSHF 
-£>tfd i s c a r d_a 1 1 -ffi»7t**^Etts 
e a r c h_mo d etf^tU-fef F£ft3„ BP*k 20 
FLUSHF-i^&tfd i s c a r d_a 1 1 ©fi# 
£fo-££<fcoT+F- F£ft3o 

[0 3 2 2] IE!g?ij7£-F3-F 

— ou±.(dvujw vvwmm^Q x o i tfiij-tfx 

*-Fn-KT?*5 0 Ht> 2 3{0«±©-trP©iS£ © 
1 A^frfcttftfcflHgflU*- F F*T*fcS. ^ 

n^o feu try hx^7 7*HtSL,fcfticoxo i* 

Stti: 5&Wf^ai7*- Fn- F#65!n?fc3. % 

ft, L<DlfWJX^-h3-F(Dt§tO 30 

[0 3 2 3] *»BBOSCDPtt, T-^-FfcfiV 
T^l^ijX F 3- F© £© * 5 XtffclfJS ft3 AHc 

LT^5„ ftatntf, **v7tt$/£l$£SftT^3 

©^feSo 

A— 7y7X#-F3-F 
X2-F3-F*© Rffl 0$#tf«»©X*-Fn-F* 
OTprefix] ©SP^*Jg/£t5 J;5fCt«C i:*^ 40 

Et5„ 1) £te£«tnif->*TAU'W©X*-b:i 
- F&7, F U-ArtOHOttlIt4fiLTta< , 
* U^;I/©X*- F KO'f'KES&fif 5 c 1 1# 
£ft5 0 2) i7- ^DfcStons^^-Fn-F* 
^Tl^SmgU *ftfc £ »3X7-|glB©RJsEl!t 

[0 3 2 4] ;W FSMWtfcfe^Ttt, #5893fcJ:ft 

a\ ey?'7#- Ftf£g*5fc£— o© 

SSfiH^ft-X^-F (picture_star 50 



t, ffi=0x0 0) AMti©7£-Fn-F©gK}-t&3 
tf^©^T'fe^o CO^t)*"?, p i c t u r e_s t 
a r tttr-*fr£lifc£Sft, ^2<D7s#-F3-Ftf 
r3-KSft*. feU *tcn***-^-7y^L.T 
l^ftfcf, 7 t!y^X^— F 3- KtffctH* 

ft*£-PE-©¥8#tffrfeft3o 
[0 3 2 5] HMtSftfcl^-Fn-F* 
*f§H^t$3^T^ffi (OxbO, 0 x b K Oxb 
6) , ^g[?©i/XrAX^-h3-F (Oxb 9fr50 
x f f) Rtf->— {rVX -x^-n-F (Ox b 4) tt 

ftl^X*- F 3- KSBribfcfttt, s CTM&Otm 
ft* $ - F n - F A s Hofr 5 S T?£T <DX1jt- $ KB 
mt%o SfeSCDtt»*ftftV>**-h (unre 
cogni zed_start) X7— l/5?X£fc-fey 
F U fgft£ft&^X£- F (unrecognize 
d_s tart) va*fcttffLTfflD&**£jSr 

[0 3 2 6] 

*^fcfcv^Tro©nv7-r4 ; il^-'>3 >£y FA* 
ilffl^ftSo 

1 ) Discar d_u s e r 

2) Discar d_e x t n (MPEG 2^> • 7 

c ft 5 ©ro© n > 7 f ^ u-s/ a y e 7 f a i c u 
hSft*. 

[0 3 2 7] MPEG2^7^-Fn-F«g^oT 
l/^o ffi?!7^-F ■ jl- (e x t e n s i o n_ 
star t_v a 1 u e) HR< 40©lf 7 FttffiSIX 
^— F3— F^S'J? (e x t e n s i o n_s tart 
_code_idntifier)T'$t), SCDK* 

^Cft^*77^r«fci6t4fi!itftT^So fFS^ft 
feSSBn-Hiai? (e x t e n s i o n_s tart 
_c o d e_i d e n t i f i e r s) Rtf^ft^OF 
-^>^gl 7t^to L^LftA^, ^fiSftfcffi® 
X^-F3-Fra6S'J? (e x t e n s i o n_s t a r 

t_codeidentifier) aUf^ftfrlA 
B»*ftftl'^E3B^*-F3-K (extension 
_s t a r t_c odes) ttJi^ft^fr (Disc 
a r d_e x t n£ft#) , X(± (10) e x t e n s i 
o n_d a t a H-^>t«fcoTMft«ft«. 

[0 3 2 8] 



(55) #H¥8- 1 7 2 6 2 4 

107 108 

mm , 











OOOO 









0001 




SEQUENCE EXTN 


0 x e 8 


0 0 10 




SEQUENCE DISPLAY EXTN 


0 x e 9 




uanf? h U * ^t£5S I D 


Q U A N T_HATR 1 X_EXTN 


0 x e a 


0100 








0010 








0110 


T« 






0 111 








1000 


Wft-s-?<y*»a I D 


PICTURE CODING EXTN 


Oxeb 


1001 


«ft-S^M^5l[ D 






1010 








1011*61111 









$17. MPEG2ffi3B**-b='-K&8ifJ L 



t°*^- • xy F (P I C TU R E_E ND) b — 
SfrOSPP (MPEGI, 2, JPEG, X«H2 6 

i) ^tn^mtommjt^mK-D^rm 

[0 3 2 9] bfrLfttffi, *J89!EJ3V>T14, SCD 
2 0 l;bV>- (i n_p i c t u r e) m 

ffnS«»*ffiKftSo £©«iP I CTURE- S 
TARTb-*>tfSCD20 1 £<fc-3Ttftf]SftSIR 
tttVOTfc-t'y h£ft3o «SLhKfeV^Tp i c t u 
re_start (Xti F L U S H 1— <fc DKl^ 

*+lWR<Z>**-F3-FttP I C T U R E END F 

-tytD^mmzto P I CTURE END I — *7 

v&£l£;*nTSrU^*-F3-FXH$t5Wpfc 
5h-^>*0HIHcai*Stl*. ttlBl n_p i c t u 
r ettP I CTURE_ENDb-*y# ; SCD2 0 1 

sitnsiBic'j-ty b*n«. fetscD2o 

I CTURE_ENDF-*:y££tt$3«£fc£#T 

am±ii3W£E--e;&5o s^-rntf, p i ctur 

E_E N D*4JS?-S5 RTtEttOfeS^^- b 3- F 
(Rtf F-2y) tt, *»Wfi:«tn(f«TOjit)tf* 

[0 3 3 0] 

picture_start_cod eX& I — ^> 

group_s tar t_code F ~~ * > 

sequence_s t ar t_c o d eXti I — %y 

sequence_end_cod b~ ^> 

FLUSH Y~$y 

Xby7- 77* • SI 

Xb«y7- 77* • £2^+ (sap) ©^ffflfi, Sft 



[0 3 3 1 ] s a p»H'y b«77?- t°^f-v -x 
>F (f 1 a g_p ictur e_e n d) fcffcTSo 
20 f l a g_p i c t u r e_e n d, 7X^^17- 
tfy F£Jn*TWT©-0©SiJffllt£>y Fi^fttSo 
1) a f t e r_p i c t u r e_s t o p : SJD&& 

*&SLTftfc s c D<Mfitr«<psfr*as , r*. 

[0332] 2) after_picture_dis 
card: COIfy httS CDPtf f 1 a g_p i c t 
ure_endffl5&**£jSl/fcfcK:di scard 
_a 1 lt-FK:a»fiK»fTl-53!pSfr*a£-rs. 
CCO^SEJ;?), d i s c a r d_a 1 1 t-KHHO 

30 ftD, d i s c a r d_a 1 1 t-K**OSStLT 

[0 3 3 3] *f§03fcttn«:\ P I CTUR E_E N D 
F-^y^SCDKJ;!3ffl*$n5ISK:a^Kf 1 ag 

_picture_endt*7 

£o tLf l a g_p i c t u r e_e 
n dtf-fey FSftTWUf, PICTURE_END© 

SCFLUSH^n, -Y^yF^^tiSo fJ 
D&Wi f I a g_p ictur e_e n d_ma s k 
40 fcft#U ($J 5 XF77tta f t e 

r_p ictur e_s t o ptffi#"f <E> 0 
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quant tfe^TftgiJKffifena,, S&©ffiSfct£T 

(ommmmmm t lt© 5 7 ^«©*§st 

J; o TflEr 5 c: i: * 5 & S fc * (ft 

8<3©6 2©«!;±T (&4ftf*ttg#©l : f<fcVh 
[0 4 15] ^>^-7i-X 

ns„ 

• i n_d a t a [1 1 : 0] 



• i n — a c c e p t 
[0 4 16] 

• o u t_d a t a [1 1 : 0] 

• o u t_e x t n 

• i n_v a 1 i d 

• o u t_a c c e p t 

m?9W i zzttttTob-^vESflFta. 

[0 4 17] 

• P I C T U R E_S TART 

• ALTERNATED CAN 

• DATA 

• Q U A N T T ABLE 

m±X(DY~^y\i \ zzrt£{fjE2ftSci:ft<l 

J^lTSo 

[0418] P I CTURE_START 1 — %y\% I 

z z icslt-o©*** 6*^fr snr 

I^Sfr£Stf^©«)*T-h (0fl*tf, alter 
na t e_s c an) fc-tfa (MPEG-1^>* 

gf) tU-feyb*€8o ALTERNATE SCA 

Nim^Ox f e£f|V«0 x e 6tf*JD3T5ft* 

CfctfRT&ftr— *y?a&S„ ALTERNAT E S 

CANh-^>ag4 lK^SftTl^S. 

[0 4 19] 

[S4 1] 



1 Alternate_Scan 
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al ternate_scan"tn — F£tlS 0 
[0 4 2 0] DATA h-J^tta Iter 

na t e_s c a n ©R£fc8l5'f y*7.Hv 
(MPEG-IX^-V^U) EftoTtt^gfcSn 

So a 1 t e r n a t e_s c a nti^©^ H©Sft 

TKBof-* h-^ytiiEBiEatjnscifcEas-r 

^£T*&S 0 

[0 4 2 1] Q U A N T_T ABLE h-^V&a 1 t 
e r n a t e_s c a n ©fg£tf6j?>-f X+i- V^X-tf 
P (MP EG- IX** ^U) tflE-aTSfc^ASn 
So a 1 t e r n a t e_s c a nti. : £<D®ffE<DW& 

^t-eass. pD%^A,TffM^nfch-^yDATA 

RtfQUANT_TABLEh-^yttH-B5feflt)* 
^T^^nSnltgtt^So r-*h-*^±, ffi 
tf7- I mo d e 1 tf*fttfIESiEJBjS2ft-CV5C. 

LfrLft^SQU A N T_T ABLE E"3V">T 
<t 5 4SH±iV\ ft 0 £37uT'JM2ftfc Q U 
ANT_TABLE h-*>0^*^Lftttfttf* 

*fS8L&M*Uf&5&V\ *58WtJ:niif, DAT 
ARlfQUANT_TABLE r— I ZZ'VDA 

tt&i^xtmt s t * taster fc 1 1 1, 

fcV^Tb— ?M±iE5lfta (6 4) ©r-*|gi:ft5*§ 
ST'ft tfftfcfft 5 ftv\> c ft & ©fits * ft5 r- * tt 

ast?ttft < , 5 < b-^ yoBB&fitfflfc u 

>jy^RAM(C(c/tS/cS#ftLT^/ctefflft{Itft 
S„ IrISHC, gjfiff5DATARtfQUANT_TAB 

LEh-^yttti* ctevt iesiej&jSS n/t h - ^ > 

[0 4 2 2] gtJfcSA^jKSftfcb-^luK^ 
1 «p$©£T© GBSEJM^ftfc) b-*y«IEL<jR 

xx7- ^fiSc^ns^tttS^n* 
vx*- 

I ZZOHtfjKfc^T, ^Bm^SDATARlfQU 
A N T_T ABLE h-^Mir^x-^SLT^ 
So Lfr L,4tf 6flH»tt*»C{4* ©-#70Kfll 
tLTK^nTV^So CC-P, r-**fri:l-Tg2£ 
tS^tfr&SWi^LTfa^rS^tfrNC^ltf 
SCSo 
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[0 4 2 3] mmii*)\ffim<D7 : — — 
T-**mtzktb, i d c -uLX^T-mmm 

NT_TABLE b-77<7)7£i6£I Z ZOtfc&fclEat 
[0 4 2 4] 

[fg4 2] 





ig}07k¥Ji&*S! -u 


0 


0 


1 


2 


3 


4 


5 


6 


7 


0 


0 


8 


IB 


24 


32 


40 


48 


56 


1 


1 


9 


17 


25 


33 


41 


49 


57 


2 


2 


10 


18 


26 


34 


42 


50 


58 


3 


3 


11 


19 


27 


35 


43 


51 


59 


4 


4 


12 


20 


28 


38 


44 


52 


60 


5 


5 


IS 


21 


29 


37 


45 


53 


61 


6 


6 


14 


22 


SO 


38 


43 


54 


62 


7 


7 


15 


23 


31 


39 


47 


55 


63 



£4 2 IZZEDftffgfc 



v^ni/n-fe'y+j- • ^^-7x-X • 77-fe7 20 
I Z Z©a^©ffitgtfc^Tav^^n7°D-tZ7^ • 7 

S*nSo I m o d e 1 OBBfitfeVT-jaff 5 C 
[0 4 2 5] ffi 

roll y{Cfe^5*fj£f5!Kl^illl-T*5*»5-e3b 
LfrLfttfe., SE&TcEfe^Ttt, <<7*-U- 
7 2 ft/cHffi7 * - V 7 b 3 * £ *1f fcttt < H 

7b-AHffi£fctf^iJ 

COt-HtfcV^Tfi, S¥7U-A*^fW£/£2 40 
S^OJO<T**o tftttiEBfc* Broil y{c43V> 
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[0 4 2 6] • 7-f :7?BS6£ft£ftv 
Ttf 5 d fctf?*, Cft«^7 WKDlTfut: y b£<fc 

7 ^ -;b K £ fi*f 3 <£>*\ * 5 <^TSa*P7 ^ -;b 

[0 4 2 7] untioT^ 4O0$££#*£tatfft 
£>f\ ^^SE^7 b;l/OSTffiO-OOe«y b©^ 

^7b^ [1] =0s ^7b;P [1] =0 

0 7 1 ic^SftfcfcK, • 7^;b7V77'«^ 

tn, §S¥7^-;bb^e8 (4) yjytmzti 

[0 4 2 8] ^7b;b [1] =0, -<7b;v [0] =1 
mK, H7 2t^«nfcj0<, 1 7 (9) ^7tfl 
Sft, 9 (5) 5>rytf±95 (by 70 S*p7^-;bb* 
frSIMttu 8 (4) WhA) 1*7^ 

"*7b;b [l] =K ^7b;b [o] =0 

gtf, H7 3CS*nfeSP<» 5<fc5fc*16 (8) 7^ 

yt>m$n& \m e t , im i?a^ jHaos±7-< 7#r 

[0 4 2 9] ^7 b;b [1] =1, ^7b;b [0] =1 
^LT, H7 4&17 (9) 7-f>tftl$tU 8 (4) 
7-r>S'±a5»P7-f-;l'Hfr5KStU 9 (5) 5^ 

y^T^»7^-;bb^5^sn5iit^bTv^ 
§o iot, t*7h n±if-&e.oS¥7^-;i/HA^iJ 

T^SA^UT^S. Jn*T\ &Lt:y bOtf-fey b 
S titi^ntf, *fttt 5 cdS^7 -< b 

[0 4 3 0] ffi£07-f-^F#DRAMfr5H#HJ2 

7f-;bF • 7b7£fcnti,^7-b7 bfc#5fc«>£S 
Sl)t^7 b;b%77-U fc t£tt*#fcffig 

^afcteffft^ft^o «Toa, S4 3, 

[0 4 3 1 ] 
K4 3] 
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•7 4->\,nziiW2>*-7-tev V 






±MV4 -/UK 




-2 


■11100 


-11110 (-2) 


— 1111 (- 2) 


—1.5 


■■■11101 


-11111 (-1) 


-11110 C-2) 


-1 


-11110 


-1 111 (-1) 


-11 1 1 1 (-1) 


-0.5 


-1 1 1 1 1 


-000 0 0 (0) 


-11111 (-1) 


0 


-00 0 00 


-000 0 0 (0) 


-00000 (0) 


0.5 


-0000 1 


-0000 1 (1) 


-00000 (0) 


1 


-00010 


-00 00 1 (1) 


-00001 CI) 


1.5 


-00011 


-000 10 (2) 


-00001 CD 


2 


-00 100 


-000 1 0 (2) 


-00010 CI) 



EOt-Ffcfc^T, *7-r-;i/KttSfcfiLTftton ftT«J©±^7^-;bF;WM2ftSo 

50 SU^©^ hMz-307^-;l/K©^tffl^?i fi7;V- 7^-YA (7U-Aliffi£fctfS) 

ftSo a*** h;l/ca^flJ^±gpaa(S7Y-;bF^?)tT fa7;l/ • 7°^A«iuffi©7^-7bF£a-j'<^iJ© 
t3ns^t»^iT^S*7^-;bF^?»tT^tiS^ xa7;b-7°vYAl»SWC, z 

ta^tlim©*-^ h7v?' (mo t i o n_v o©4#®*Jfi#£fe-frfcfc©-e*So 

e r t i c a l_f i e 1 d_s elect) [0 4 3 6] • 40©»uL/c (?n^B^«»5 

tf^tiSo ^^h;bO*T*l?f Mi&fe^M/l/ ■ 7-f ^^h;l/4WT4i:v^*!*"eaSLfc) 7^-/1^ 

^uvw^g-essiits^LTva^nHfex tr 20 ij#iM£ftsn^«fitkf^f\ $t&±.iti£—o 

7 h 1 EMttwai4*»ttJ»/\ 7^-;i/H • h o»fr^* ww^sttsfcfcoftgija^ hMHt 

5 , 7 -c F • h /b©ffitf n T?ft II S'>-f S 0 

if 2 n©7l^-A^ h;l/fcR-0*H©Sffi • &7^-;l/FfcttLT, ^9JflH8^S*P7-f-;l/HO 

[0 4 3 2] C©*£, LfrLfttffc, (4O0«ISLS Sfi«2tl5 0 COCfctt, ^©fu75M£7J 

51 !P*,ro©^ Wl/©£4©fti6©mo t i on_ ^»%t>tlT^c¥^t$nS B -iSM©±I^t^ 
v e r t i c a 1 _ f i e 1 d_s e 1 e c t Rtfro fcSMlLTV>*. #Mcfc^T, ^ F;l/©£*f tt 

1 6 0»^K^T#JlLfti3-niif45ftl'\ ffiHt^ 30 £§tt$S£f, SBt400BiJ^O^^b;WffiF*Et 

tl£^#^<#£tS/ctfK WT©ElT?tt±gP7 So 

^-;UK«M*8llfcoivt©*»5. T*7-f-;l/FttRI [0 4 3 7] ra7;U • 7^A¥m:«B-7l/-A 

«<JD£ffifcJ:oT*SSti:tfT?*«. ^kSSS^Sffiffl-rS^ttiD^T^nS (ri7 

[0 4 3 3] H7 5tH/^^n/c^P<, motion_ ;V ■ 77^A*ng#aB-71x-A£:feV'>Tfl!^3<: 

v e r t i c a l_f i e 1 d_s elect = 0^ tttH'Zfr^) . ^$J0K£H^tS*-©M£m 

*f;v to] =0©^ 8 (4) yjyftmm? m^-m (m^h^h-^ym^mik) am 

2ftS 0 17 6l±moti on_ve rtlcalj ?r2nfc(f*5*^i: £%*timJ5^m%LT^ 

i e 1 d_s elect = 0,^Wb [0] = 1 O* So P-SHS, $7rp«l£g$*SlHi£<»^ 
^iL, 9 (5) 7^>ff±SBg¥77^;W5§g* 40 fci6, »J@K^ rfctfj ^«l©fci&£ Z*>e><DW$ 

$J©±^7^-;bF»rfSo (PXttB) ©ias*ffl^l-5c:fc©**^-e 

[0 4 3 4] [Htfftv 07 7limo t i o n_v e r t feSo 

i c a l_f i e 1 d_s e 1 e c t = K O Y)l H®7^-;b Frt©^»J 

[o] =0©tI££^bT^So 8 (4) <7<<yirf& 7^-;VFtSoX^ffl 
W^IA -71/ F*^l*tH^nT ; PiJ©±g|37 -Y F 7 b-AH®rt©7 ^ -;]/ K£g-3< 

;WM2tlSo fits 17 8(imot i o n_v e r ^tdi^LTfc^ mo t i o n_v e r t i c a 1_ 

t i c a l_f i e 1 d_s e 1 ec t = K f i e 1 d_s e 1 e c t RtfKjt'S* Frt>©£Tffi£ 

[0] = 1 ©J§£**LT^5„ "f btffiSLT 40©«£tf#£*5. ^iJa*£rn 
[0 4 3 5] 9 (5) v-(ymtm^l^-)^^h 50 -F^tlT^SHffi (±±gP7^-;l/FX«£TgP7f 
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(74) 
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-;I/H<0MWT*5) (DTzibTshZft^s JgjSSftfc 7^-^FHffitfcttSr:i7;l'7V-'f A 
^»©±gP7Y-;bFRtfTgP7^-;i/F%!IiiTS 7^-^FH®tfcttSr^7;b7^A«:7^- 



[0 4 3 8] 07 9ttmo t i o n_v e r t i c a 1 20©7^-;l/F^ F;W€ffl$ftS (-£tf±gBg 

_f i e 1 d_s e 1 e c t = 0, O hfr [0] =0 Jp7-f-;l>F*#JKU {ffi7^T^S¥7^-;bF4# 

©$££*ltv5„ 1 6 (8) 7-<y* , ±»a*7-f ml, ^-^^;:n%5ts-r«) o wj©-^*^^ 

0 t i on_ve r t i c a l_f i e 1 d_s e 1 e ^ailslKa cin*S 2 ©hu^SI ^ bT» 
c t=0, ^Zbfr [0] = 14)»£*a*LTVV5. ffltSo * Ojg&oroEl^aitt B -7 Iz-AT^bt 

[0439] 17 o) 7-r>*»±»»P7Y-;i/Hfr io fc^Tfflv^n/tfe© ^^-©niK^ffl^TWbsn 

138 llimo t i on_ve r t i ca l_f i e [0 4 4 4] £ft«j£M 

1 d_s elect = K^^[0] =0O*£4 H8 7l±, ^KiSf^^W^^'f^ 
*LT^3. 16 (8) ^>tfT3|3»P7^-;bFfr «»4*LT^S 0 f-^(±DR AM^^-7i 

[0 4 4 0] 08 2&mo t i o n_v e r t i c a l D R AM-f y*-7x-*ttr-*SiEil*>W F 

_f i el d_se lect = 0>^^ [0] =1 $[©±©#©3 KD^ST^t)±lf Bflfc^ 

16X8MC [0 4 4 5] T-*CftI*T» DR AM>0*-7x- 

COt-Ffcfcl^T, i^O'^a, *tt&f-*>*;I/ (Y, CrCbtT, *©>W Ftf£ 

±E2dS-0© 1 6 x 8flWKiMW«nTV>«, &f($ «E?)f^^W7'f>Ol«7S5il , 5mf 1 £ 

tJfLT, BU4©7-r-;l/F • ^ h;u^et«ti«. y F*{J8&*So St, r-*tf H©7-r-;l/Ffr5* 

mo t i o n_v e r t i c a l_f i e 1 d_s e 1 + :/*;MC$ftMl*. ft (C r&t/C b) r-^ttSK 

ectandt ro©^* h^O^CStJlf^ F 7 -y 7° -^77-2 1 OlcffifciSft*. Sfi (Y) r 

0tf#£-f5fc4M c SfcStf, E^t^^il^^T t>L&m-V%m, F I F 0rt?iffi£2nS o 
#5fe», WTO0T(i±{4© 1 6 x 8fj$(CO^T© 30 [0 4 4 6] SB7 7 7 • ^>7?- 2 1 0 lifer*-* 

*?&5o Ttt«fig«ttHa«^ST#«Ci:^-efr«o 42 : 1 ©$J£T-T?7y7- ^y7U y?'LT»gr- 

[0 4 4 1] 08 3 lira o t i o n_v e r t i c a 1 $rfcHUR©fir-*©7-rytfS5*3fc-f 5fl*J* 

_f i e 1 d_s e 1 e c t = 0, MP [0] =0 S^TV>5 0 Jltl^ o y ^ ■ ^yfv- 

Ol£*iSLT^*. 8 (4) 7-rytf±9J»P7Y- Bfer-^Oft^-fyfcttttU CO^^^RtffiWO 

;UFfr5SMSnT±ffi 1 6 x 8»»WJ VICKIE HAP £n/cW7J^44$TSo #©rV 

tlS 0 08 4«mo t i on_v e r t t i c a l_f X7W • /W77^>rtOXf-^a" 7j<WiJt§3 

i e 1 d_s elect=0,^h^ [0] =l©f 7 0" fcS^SttT^*. Clfttt, WF7Vf'Vy? 

■&**LTl^*. 5-2 1 2©^ttT^^tlTfcD, ^©fSSiJtt, 

[0 4 4 2] 9 (5) 7-rytf±a9PP7-f-;l/H^5 r-**»!l*-&T#7>r>0*&«)K*JV'>T, 3O0f 

ii#fflSftT¥'"W • 7^;v^u >^n, ±{fi 1 6 x 40 ^y*/u©&/?©n i <D*)W&¥7y7'- yyy°7- 

Sffl&tD^ffllMf&ZftZo BI8 5ttmo t i o n_v 2 1 2 EIBtE-W^ftS £ 5 EfS d fc"?2&5„ 

erticaLf iel d_s elect = l,^ tiB^TS, -flSt, Q^^y^MiWz 

h)l [0] =0O«^%SLT^a. 8 (4) SBfHE" T-^tfiKftS" tfctfmsnSo " ?J< 

T$S$7-f-Jl/Kfr5fl*tB2tiT±ffi 16x8<D? ¥S?iJ#b" 7ny? 3 7 0«5§*#©r-***ftSr-ir 

[0 4 4 3] 08 6limo t i o n_v e r t i c a l f-^y^^W^ft^ 3O0ft^*;KD^Ttf 

_f i e I d_s e l e c t = K F;U [0] = l ffiH^t)-a:*nT^©7 f ^^^ , U'('7-('>OBII5&A^*l 

©»&**LTV3. 9 (5) ^ytfTMP7Y- a^fctStfcjWrtTCi&S. 

;bK^5R*tfJ*nT^;l/- 7^;H"J>*2ti±te [0 4 4 7] *fS8£:fe^T\ fflTV? -Vy??- 

1 6 x 8©M«£ftSo 50 2 1 2ttr-***¥E7'y 7 ■ tf^U ^LTr- 
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5/1; nyojBStfcfi^-rsfcfefc, 3oofty*;H- 
7-f;i>*tt&*r£*vTVSo 7^;b2o-gff-<DHrti}Ifi 

t±2 7M^-Cb/s WP7^-h) T?4ttfttfft& 

1 r 6 0 1 mm^mitzn, £ t>£jfc£nfc 

r-£7 F 'J-Att$|Et|Pftf-^ h U-A 

[0 4 4 8] *¥7y^-U->^7-2 1 2tt*EDR 
AM>f^*-7x-*£J:!)flUi&2ft4*®T-**IR 10 

tt*i^5, co»*tHrr*cfcttSi-eftv>. 20 

SM§7n 7 ? 3 7 0 SStSUT" *tr-^ 
^©3O(D^-v>^;l/Cig-^07j<¥77 7 1 • *yy?y- 

2 1 2fc#8&-rS. BPS, 7k¥77 7° • ^T^-a 

[0 4 4 9] VTG 3 3 3tt#MfCv7^-OH*'?>' 
h U tt}7J^77b7 773 71 Kfltt&SnS-SO 30 

^1/^9^7 3 7 ncg^7^-£H©«£L 

ft£&S7cffl7JV;1^7U7?7 3 7 lBSttWti 
[0 4 5 0] tfJ7T7;l/f 7Vy**3 7 1 7*ny*tt& 

■f5^Htf*5o 7j<¥77 7-^>7°7-2 1 2fr5ffi 40 
^n/c7-^a*rclijl-r§7^j7 F (S3) ff^£ 
tfl/tv* (^LTttJ£v;l/^7b7*7«§ttA*i4l 

^tt2»it^y^-7x-7^tbTfcP»f, *ny* 
• *M>/)]MK. 1 Ff OJMfiK 7 P 7 7ti57J£ft 

[0 4 5 1 ] ffi7JV;l/?-7°U7 77 3 7 lttSfeHffii© 

@ t) Kmm<mmr> tw. ±4ffit5«fctf£©is 

WiVTG 3 3 3£.t5fflfflIK:t£^Tffifrn5o V T G 

3 3 3 M»Cffi£v;l/^7W 77 3 7 1 C&ftfeO 50 
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^;b^s*a^it^t5«fc a ci^i;So hs©£&. 

tfTSKfe^Ttt* tti7J^;bf-7°b7^7 3 7 1 tt*tl 
g^TW&fiK, BPS,, v;bf-7°b7 77 3 7 lttH 
ffir-* tftt < ft S £ tbZtiZfi o^Ztm^T^ 

2><DT°&2>0 

[0 4 5 2] rV77 0 U-Y7W7°7^>rt©«tl©7'P 
7 * tt 8 e 7 F - 1 6 e 7 F ft**- KgSlffi 3 7 2 7? 
$5. il tittffi < 7 U 7 7°7 a 7 7°Rtfv;l^7 
U*U-fr5j£S„ CWi, tH7JPAD^ng#Efc^T 

<X 1 6e'7h^7^K^bDt^M£8e7h7U 

« i < d t mmt * a . §^ © e y h «r oo tH7j^ 

7 FCltfo 

[0 4 5 3] 7joF77 7°-^y77- 

*i 

#5BE£ftfttf> 7k¥77 7--9-y7°7-2 1 2Bf3 
- K * n/c Hffifc 7V 7 7 7 7 £ - £3S£T § £ 5 
icifc*:* Sfcftfc 7 7 7° • -9" V 7 U V 7"g L < (iHt 

[0454] ifrnmr-j-f -^y-fy-2 1 2h«t 
<d 4 oot- FTinrrs c tmm-v&Zo 

1) 1 : l-tti*ttA*l:ra- 

2) 2:1 

3) 3:2 

4) 4:3 

3OTtffl£^tL/ci^ ffiKlfcfrS fcfcfcH* 7 7° 

©7^;i/*£^*5cfca^Sftfc. 
[0 4 5 5] C^^T^^T^ 7-r;i/*fl8R 

©gft5fi^fflv^T§asufctH7j*^fi)c?n§ti/^ 

%&.-V&M<D74 )WV&5„ \m<Dm$n E777 • 
^V^Uy^JtW^fc^U^o 5 K LT, 4 : 

3 77 7 P --U->7 P 7-a40©ffiffi^U &4#@© 

tii7j-9-y7 , ;W|il-07^;i/^^a^ffl^T4fi£$n 

So 

[0 4 5 6] Jy^-^y-fy-Z 1 2{i?titfA7JT 

ft*, liTb^A7J^>7°;^7D7 7lfflSt§ttA 
n^nftVCfcttWA^ftSo m 7^;b^A^fft^ 
A71^tAnft^ffiffl^a777 • -9->7U >7"tt 
0^kiM&03SaE*bV\ irt©^^ (1 : 1*1* 

^ft^-r^^tfev^T, f«oflo-otfe^T 
ifrL^A7^r-^^SttAn?)tiftV\ c:©^ r- 
^ttt5oteffi©r-*i:li-"e*5o 7^;l/*fl9![{4, 

4 : 3 77 7°-^>7°U>^ 

4 : 37yf •^-y/vy^^r, Uht&Mt 

S4 4t^nTfc0s H8 8li7-f;P*OSlf^*^L, 
TVS. tH7J^^f±*©WEttA7J^I/©»*#t¥^ 



[0 4 5 7] 
[S4 
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[04 6] 04 6(4*f6^0^XrA^LT^n^^ 
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[07 1] 07 11^ [1] = 0StP^b;b 20 
[0] =OtfcltS7U-AtS-j'^fc^»J^^t0T 
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[HI 1 8] HI 1 8S#f&HBfc*5tt3 2 0SDRAM 
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[HI 2 4] HI 2 4ttV^^P7°D-fe-y^>^-7 
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VIDEO DECOMPRESSION 

This application claims priority under British Application Serial No. 
9415413.5 filed July 29, 1994. 
5 The present invention relates generally to a new and Improved 

system for decoding a plurality of audio and video signals and. more particu- 
larly, to a new and improved system for decoding a plurality of MPEG audio 

and video signals. 

A serial pipeline processing system of the present invention com- 

1 0 prises a single two-wire bus used for canying unique and specialized interac- 
tive interfacing tokens, in the form of control tokens and data tokens, to a 
plurality of adaptive decompression circuits and the like positioned as a 
^ reconfigurable pipeline processor. 

United Slates Patent 5,1 1 1,292 discloses an apparatus for encod- 
1 5 Ing/decoding a HDTV signal for e.g. terrestrial transmission includes a priority 
selection processor for parsing compressed video codewords between high 
and low priority channels for transmission. A compression circuit responsive 
to high definition video source signals provides hierarchically layered 
codewords CW representing compressed video data and associated 
20 codewords T. defining the types of data represented by codewords CW. The 
priority selection processor, responsive to the codewords CW and T, counts 
the number of bits in predetermined blocks of data and determines the 
number of bits in each block to be allocated to the respective channels. 
Thereafter the processor parses the codewords CW into high and low priority 
£ 25 codeword sequences wherein the high and low priority codeword sequences 
correspond to compressed video data of relatively greater and lesser impor- 
tance to image reproduction respectively. 

United States Patent No. 5,122,875 discloses an apparatus for 
encoding/decoding an HDTV signal. The apparatus includes a compression 
30 circuit responsive to hig h definition video source signals for providing hierar- 
chically layered codewords CW representing compressed video data and 
associated codewords T. defining the types of date represented by the 
codewords CW. A priority selection circuit, responsive to the codewords CW 
and T, parses the codewords CW into high and low priority codeword se- 
35 quences wherein the high and low priority codeword sequences correspond t< 
compressed video data of relatively greater and lesser importance to image 
reproduction respectively. A transport processor, responsive to the high and 
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low priority codeword sequences, forms high and low priority transport blocks 
of high and low priority codewords, respectively. Each transport bbclt in- 
cludes a header, codewords CW and error detection check bits. The respec- 
tive transport blocks are applied to a forward error check circuit for applying 
additional error check data. Thereafter, the high and low priority data are 
applied to a modem wherein quadrature amplitude modulates respective 
carriers for transmission. 

Accordingly, those skilled in the art have recognized a long felt need 
for a new and improved video decompression system obviating the deficien- 
cies of the prior art systems. The present invention clearly fulfills this need. 

Figure "I Illustrates data flow through a preferred embodiment in the 
present invention; 

Figure 2 shows an example of a 13 bit word used to address a bit 
data in a 84 X 32 RAM: 

Figure 3 is a functional block diagram of a Register file in the 
present invention; 

Figure A illustrates dala flow in a register file as shown In Figure 3; 
Figure 5 is a block diagram illustrating register file address decoding, 
in accordance with the present invention: 

Figure 6 is a block diagram of a Microcodable State Machine, in 
accordance w'rth the present invention; 

Figure 7 shows a fixed width word, in accordance with the present 
Invention, used for addressing and having an address field, a substitution field 
and a substitution header; 

Figure 8 is a block diagram of one example of an Arithmetic Core in 
accordance with the present invention; 

Figure 9 illustrates the basis steps in a method, in accordance with 
the present invention, for performing an IDCT on input data; 

Figure 10 is a block diagram Illustrating the combined, simplified, 
two-stage architecture of an IDCT system, in accordance with the present 
invention: 

Figure 11 is a simplified block diagram of an integrated circuit that 
comprises the main system components of the IDCT shown in Figure 10; 

Figure 12a and Figure 12b taken together are a block diagram of a 
pre-processing circuit corresponding to one of the main system component; 
for ease of explanation, these figures are referred collectively as Figure 12; 
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Figure 13a, Figure 13b and Figure 13c depict timing diagrams which 
Illustrate the relationships between timing and control signals In the IDCT 
system of a preferred embodiment 

Figure 14a and Figure 14b taken together are a block diagram of a 
common processing circuit in the IDCT systenrtfor ease of explanation, these 
figures are referred to collectively as Figure 14; 

Figure 15a, Figure 15b, Figure 15c and Figure 15d taken together 
are a block diagram of a post-processing circuit which corresponds to another 
main component of the system and are referred collectively as Figure 15; 

Figure 16 is a block diagram, in accordance with the present inven- 
tion iSuatrating an IDCT having a twin data stream, a transpose RAM and an 
improved buffer; 

Figure 17 Is a block diagram showing in further detail the 1-D IDCT 
system shown In Figure 16; 

Figure 18 is a block diagram showing greater detail of the transform 
system - as shown in Figure 17; 

Figure 19 is a block diagram showing in greater detail the input 
buffer shown In Figure 18; 

Figure 20 is a simplified block diagram of a pre-processing circuit 
"PREC", in accordance with the present invention; 

Figure 21 is a block diagram illustrating a common processing circuit 
"CBLK" found in the IDCT; 

Figure 22 is a block diagram of a post-processing circuit "POSTC"; 

Figure 23 is another illustration of the post-processing circuit shown 
in Figure 22; 

Figure 24 is a block diagram depicting a round and saturate block, in 
accordance with the present invention; 

Figure 25 is a block diagram of an output buffer in the present 



Figure 26 is a block diagram of a control shift register, in accordance 
with the present invention; 

Figure-27 Is a block diagram of a control shift register decode in the 
present invention; 

Figure 28 depicts a control shift register and an input control buffer; 
Figure 29 Illustrates a control circuit for a T2 data stream; 
Figure 30 shows data in a counter for a T1 data stream; 
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Figure 31 depicts data in s counter for a T2 data stream in the 
present invention; 

Figure 32 Is a timing diagram showing the initialization of the 1DCT 
and associated circuitry 

Figure 33 is a timing diagram showing the interleaving of T1 and T2 

data; 

Figure 34 is a timing diagram Blustrating slippage and recovery of T2 

data; 

Figure 35 is a timing diagram depicting a flushing operation of the 
IDCT and associated circuitry in the present Invention: 

Figure 36 illustrates start-up of the system, in accordance w'rth the 
present invention; 

Figure 37 depicts sBppage and recovery in the early stages of 
interleaving T1 and T2 data; 

Figure 3S illustrates another preferred embodiment of the IDCT 
system" shown in Figures 16 through 37; 

• Figure 39 shows MPEG information streams being demultiplexed, in 
accordance with the present invention, into elementary streams containing 
date and timestamp information; 

Figure 40 depicts a first embodiment of an elementary stream 
timestamp error determination and time synchronization system, in accor- 
dance with the present invention; 

Figure 41 Illustrates a second embodiment of an elementary stream 
timestamp error determination and time synchronization system, in accor- 
dance with the present invention; 

Figure 42 shows a third embodiment of an elementary stream 
timestamp error determination and time synchronization system, in accor- 
dance with the present invention; 

Figure 43 depicts a first embodiment of a video timestamp error 
determination and time synchronization system, in accordance with the 
present invention; 

Figure 44 illustrates a second embodiment of a video timestamp 
error determination and time synchronization system, in accordance with the 
present invention; 

Figure 45 shows the second embodiment of a video timestamp error 
determination and time synchronization system as shown in Figure 44 and 
operating at 30Hz; 
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Figure 46 shows timestamp information flow through the system of 
the present invention; 

.,„ Figure 47 is a block diagram 'illustrating synchronization time Infor- 
mation being processed by a microprogrommable state maohine; 
5 Figure 48 is e block diagram illustrating a first preferred embodiment 

of the present invention; 

Figure 49 is another block diagram illustrating thB first preferred 
embodiment of the present invention; 

Figure 50 depicts a second preferred embodiment of the present 

10 invention; 

Figure 51 illustrates a detailed method of addressing used by the 
second preferred embodiment, in accordance with the present invention; 

Figure 52 is a block diagram showing an apparatus for decoding 
Huffman VLCs, in accordance with the present invention; 
15 Figure 53 is a schematic diagram showing the overall structure of 

the parallel huffman decoder of the present invention; 

Figure 54 is a schematic diagram illustrating a ROM ad apted for 
decoding parallel huffman codes; 

Figure 55 illustrates a first embodiment of a ROM adapted for 
20 decoding parallel huffman codes; 

Figure 56 illustrates a second embodiment of a ROM adapted for 
decoding parallel huffman codes; 

Figure 57 depicts a third embodiment of a ROM adapted for decod- 
ing parallel huffman codes; 
25 Figure 58 is a black diagram Illustrating the primary system compo- 

nent of one embodiment of the present invention; 

Figure 59 is a block diagram depicting the start code detector of the 
present invention; 

Figure 60 is a block diagram showing the parser of the present 
30 invention; 

Figure 61 is a block diagram depicting the primary components of 
the spatial processing circuitry of the present invention; 

Figure 62 is a block diagram illustrating the display circuitry, in 
accordance with the present invention; 
35 Figure 63 illustrates one embodiment of timestamp management, in 

accordance with the present invention; 
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Figure 64 shows another embodiment of timestamp management in 
the present invention; 

Figure 65 is a block diagram depicting the hardware components of 
the system of the present Invention; 

F.gure 66 is a block diagram providing an overview of the system 
component* of the microcontroller of the present invention; 

Figure 67 is a simplified diagram illustrating the Arithmetic core of 
the present invention; 

Figure 6B illustrates the ALU of the present invention; 

Figure 69 depicts a register file, in accordance with the present 
invention; 

Figure 70 illustrates the writing to independent bus registers in the 
present invention; 

Figure 71 illustrates frame-based prediction wherein vectorll] = 0 
and vectorfO} = 0; 

- Figure 72 depicts frame-based prediction wherein vector!!] = 0 and 
vectorfO] =1; 

Figure 73 shows frame-based prediction wherein vectorfl] = 1 and 
vectorJO] = 0; 

Figure 74 illustrates frame-based prediction wherein vector[1] = 1 
and vectDrf.0]= 1; 

Figure 75 depicts field-based prediction wherein 
motion_vertical_field_select = 0 and vectortO] = 0; 

Figure 76 illustrates field-based prediction wherein 
motion_vertical_field_select = 0 and vectorfO] = 1 ; 

Figure 77 similarly Illustrates field-based prediction wherein 
motion_vertical_field„select = 1 and vector[0] = 0; 

Figure 78 shows field-based prediction wherein 
motion_vertical_tield_select= 1 and vectorfO] = 1; 
) Figure 79 shows field-based prediction in frame pictures wherein 

motion_vertical_field_select = 0 and vectorfO) = 0; 

Figure 80 illustrates the prediction of Figure 79 wherein 
motion_vertical_field_select = 0 and vector[0] = 1; 

Figure 81 shows the prediction mode of Figure 79 wherein 
5 motion_vertical_field_select = i and vector[0) = 0; 

Figure 82 shows the prediction mode of Figure 79 wherein both 
motion_vertical_field_select and vector[0) = 1; 
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Figure 83 illustrates an additional mode oi prediction filtering; 

Figure 84 shows still another prediction mode; 

Figure 85 illustrates yet another prediction mode, in accordance with 
the present invention; 

Figure 86 shows another prediction mode of the present invention; 

Figure 87 is a block diagram illustrating the organization of the 
various system components of the display system of the present invention; 

Figure 88 depicts a 4:3 filtering operation; 

Figure 86 depicts a 3:2 filtering operation; 

Figure 90 Illustrates a 2:1 filtering operation erf the present invention; 

Figure 91 shows a three tap filter used in the present invention; 

Figure 92 illustrates the repetition of erroneous pels; 

Figure 93 depicts the fitedjd signal of the present invention; 

Figure 94 shows the horizontal timing points (cycles), in accordance 
with the present invention; 

- Figure 95 illustrates the PAL vertical timing at 625 lines per field, in 
accordance with the present invention; 

Figure 96 illustrates the NTSCV vertical timing at 525 lines per field, 
in accordance whh the present invention; 

Figure 97 shDws a horizontal counting machine, in accordance with 
the present invention; 

Figure 98 illustrates border generation in the present invention; 

Figure 99 depicts picture cropping, in accordance with the present 
invention; 

Figure 1 00 is a block diagram illustrating the present invention as a 

chip; 

Figure 101 illustrates theaysclock requirements of the present 

invention; 

Figure 102 depicts the two-wire protocol on a coded data interface, 
in accordance with the present invention; 

Figure 103 shows a DATA token of the present invention; 
Figure 104 shows a FLUSH token of the present invention; 
Figure 105 illustrates the timing of the coded data interface; 
Figure 1C6 depicts using non-even mark-space ratio CDCLOCK. in 
i accordance with the present invention; - 

Figure 107 shows output timing in 16 bit mode in the present 
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Figure 10B illustrates output timing in 8 bit mode in the present 

invention; 

Figure 109 shows the timing of trie video output interface in the 
present invention; 

Figure 110 depicts video output mode signals, in accordance with 
the present invention; 

Figure 111 shows horizontal liming in the present invention; 
Figure 112 shows the vertical timing for a 525 line system; 
Figure 113 depicts the vertical timing for a 625 line system; 
Figure 114 Illustrates the sync and blanking signals for a 525 line 
system, in accordance with the present Invention; 

Figure 115 shows the sync and blanking signals for a 625 line 
system, in accordance with the present Invention; 

Figure 116 Illustrates a zero SDRAM connection configuration in the 
present invention; 

'• Figure 117 shows one SDRAM connection configuration in the 
present invention; 

Figure 11B depicts a two SDRAM connection configuration. In 
accordance with the present invention; 

Figure 119 illustrates a three SDRAM connection configuration 
Figure 120 is a flow chart depicting the fiag_picture_end operation, 
in accordance with the present invention; 

Figure 121 is a flow chart showing the start_code_search operation, 
in accordance with the present invention; 

Figure 122 shows timestamp modification. In accordance with the 
present invention 

Figure 123 illustrates the read timing for the microprocessor inter- 
face; and 

Figure 124 shows the write timing for the microprocessor interface. 
In the ensuing description of the practice of the invention, the following terms 
are frequently used and are generally defined by the following glossary: 
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GLOSSARY 

BLOCK: An 8-row by 8-coiumn matrix of pels, or 54 DCT coefficients 
(source, quantized or dequantized). 

CHROMINANCE (COMPONENT): A matrix, block or single pel representing 
one of the two color difference signals related to the primary colore in the 
manner defined in the bit stream. The symbols used for the color difference 
signals are Cr and Cb. 

CODED REPRESENTATION: A data element as represented in its encoded 
form. 

CODED VIDEO BIT STREAM: A coded representation of a series of one or 
more pictures as defined in this specification. 

CODED ORDER: The order in which the pictures are transmitted and de- 
coded. This order is not necessarily the same as the display order. 
COMPONENT: A matrix, block or single pel from one of the three matrices 
(luminance and two chrominance) that make up a picture. 
COMPRESSION: Reduction in the number of bits used to represent an Hem 
of data. 

DECODER: An embodiment of a decoding process. 

DECODING (PROCESS): The process defined in this specification that reads 
an input coded bitstream and produces decoded pictures or audio samples. 
DISPLAY ORDER: The order in which the decoded pictures are displayed. 
Typically, this is the same order in which they were presented at the input of 
the encoder. 

ENCODING (PROCESS): A process, not specified in this specification, that 
reads a stream of input pictures or audio camplas and produces a valid coded 
bitstream as defined in this specification. 

INTRA CODING: Coding of a macroblock or picture that uses information 
only from that macroblock or picture. 

LUMINANCE (COMPONENT): A matrix, block or single pel representing a 
monochrome representation of the signal and related to the primary colors in 
the manner defined in the bit stream. The symbol used for luminance is Y. 
MACROBLOCK: The four 8 by 8 blocks of luminance data and the two (for 
4:2:0 chroma format) four (for 4:2:2 chroma format) or eight (for 4:4:4 chroma 
format) corresponding 8 by 8 blocks of chrominance data coming from a 16 by 
16 section of the luminance component of the picture. Macroblock is some- 
times used to refer to the pel data and sometimes to the coded representation 
of the pel values and other data elements defined in the mBcroblock header of 
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the syntax defined In this part of this specification. To one of ordinary skill in 
the art, the usage is clear from the context. 

MOTION COMPENSATION: The use of motion vectors to Improve the 
efficiency of the prediction of pel values. The prediction uses motion vectors 
to provide offsets into the past and/or future reference pictures containing 
previously decoded pel values that are used to form the prediction error 

MOTION VECTOR: A two-dimensional vector used for motion compensation 
that provides an offset from the coordinate position in the current picture to 
the coordinates in a reference picture. 

NON-INTRA CODING: Coding of a macroblock or picture that uses informa- 
tion both from itself and from macroblocks and pictures occurring at other 
times. 

PEL: Picture element. 

PICTURE: Source, coded or reconstructed Image data. A source or recon- 
structed picture consists of three rectangular matrices of 8-blt numbers 
representing the luminance and two chrominance signals. For progressive 
video, a picture is identical to a frame, While for interfaced video, a picture can 
refer to a frame, or the top field orthe bottom field Of the frame depending on 
the context. 

PREDICTION: The use of a predictor to provide an estimate of the pel value 
or data element currently being decoded. 

RECONFIGURABLE PROCESS STAGE (RPS): A stage, which in response 
to a recognized token, reconfigures itself to perform various operations. 

i SLICE: A series of macroblocks. 

TOKEN: A universal adaptation unit in the form of an interactive interfacing 
messenger package for control and/or data functions. 
START CODES [SYSTEM AND VIDEO]: 32-bit codes embedded in a coded 
bitstraam that are unique, "mey are used for several purposes including 

3 identifying some of the structures in the coding syntax. 

VARIABLE LENGTH CODING; VLC: A reversible procedure for coding that 
assigns shorter code-words to frequent events and longer code-words to less 
frequent events, 

VIDEO SEQUENCE: A series of one or more pictures. 
5 Briefly, and in general terms, the present invention provides a new 

and improved method and apparatus particularly adapted for use in a two-wire 
pipeline system having various control and DATA tokens. The major ele- 
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merits of the system may include a start Code Detector, a Video Parser 
incorporating a Huffman Decoder and a Mieroprogrammabte State Machine 
(MSM), an Inverse Discrete Cosine Transform (IDCT), a synchronous DRAM 
controller with an associated address generation unit, appropriate prediction 
5 circuitry and display circuitry which includes upsampling and video timing 



More importantly, various embodiments of the invention may include 
an MPEG video decompression method and apparatus utilizing a plurality of 
stages Interconnected by a two-wire Interface arranged as a pipeline process- 
ing machine. Control tokens and DATA Tokens pass over the single two-wire 
Interface for carrying both control and data in token format. A token decoder 
circuit is positioned in certain of the stages for recognizing certain of the 
tokens as control tokens pertinent to that stage and for passing unrecognized 
control tokens along the pipeline. Reconfiguration processing circuits are 
positioned in selected stages and are responsive to a recognized control 
token for reconfiguring such stage to handle an identified DATA Token. A 
wide variety of unique supporting subsystem circuitry and processing tech- 
niques are disclosed for implementing the system, including memory address- 
ing, transforming data using a common processing block, time synchroniza- 
tion, asynchronous swing buffering, storing of video Information, a parallel 
Huffman decoder, and the like. 

By way of example, and not necessarily by way of limitation, the 
present invention may include among its various features an apparatus for 
synchronizing time having, a time stamp for determining presentation time, a 
clock reference for initializing system time in a first circuit, a first time counter 
in communication with the clock reference for keeping system time in a first 
circuit and a second time counter Initialized by the clock reference in a second 
circuit synchronized with the first time counter, for keeping a local copy of the 
system time and for determining the presentation timing error between the 
local copy of system time and system time by comparing the time stamp to 
the second time counter. It further includes an apparatus for synchronizing a 
system decoder and a video decoder using a time stamp for determining 
display time, a clock reference for initializing syslem time in the system 
decoder, a first time counter in communication with the clock reference for 
keeping system time in the system decoder and a second time counter 
initialized by the clock reference in the video decoder synchronized with the 
first time counter, for keeping a locai copy of system time and for determining 
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the display timing error between the local copy of system time and system 
time by comparing the time stamp to the second time counter. 

Still another embodiment of the invention includes an apparatus for 
synchronizing a first circuit and a second circuit using a clock reference for 
5 initializing system time in the first circuit, a first circuit having a time counter in 
communication with the clock reference for keeping system time, a first 
elementary stream time counter in the first circuit for providino elementary 
stream time. The first circuit is adapted to receive a time stamp, and the first 
circuit generates synchronization time by adding elementary stream time to 
1 0 the time stamp and subtracting system time. The second circuit Is adapted to 
receive synchronization time from the first circuit and has a second elemen- 
tary stream time counter in synchronization with the first elementary stream 
0 time counter for providing a local copy of the elementary stream time and for 

determining a timing error between the system time and the time stamp by 
15 comparing synchronization time to the local copy of elementary stream time. 
In this way, the clock reference signal does not have to be passed directly to 
the second circuit in order to determine the timing error. 

In another embodiment of the invention, an apparatus tor synchro- 
nizing a first circuit and a second circuit has a clock reference for initializing 
20 system time in the first circuit. The first circuit has a time counter in communi- 
cation with the clock reference for keeping system time, and a first video time 
counter for providing video decoding time. The first circuit is adapted to 
receive a video time stamp and subtracting system time. The second circuit is 
adapted to receive synchronization time from the first circuit and has a second 
A 25 video time counter in synchronization with the first video time counter for 
providing a local copy of video decoding time and for determining a timing 
error between system time and the video time stamp by comparing synchroni- 
zation time to the local copy of video decoding time. Accordingly, the clock 
reference signal does not have to be passed directly to the second circuit in 
30 orderto determine the timing error. 

The present invention also includes a method for providing timing 
information by providing a video data stream having a time stamp carried in 
packet header wherein the time stamp refers to the first picture in the packet 
of data. In the next step a register is provided having a flag used to indicate 
35 valid time stamp information which is taken from the packet header and 

placed into the register. Next, the time stamp is removed from the video data 
stream and placed in the register. Next, the method encounters a picture 
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start and subsequently examines the status rtf the register to determine if 
valid time stamp information is contained in the register by checking the flag 
status. A time stamp is generated in response to the picture start if the flag 
indicates valid time stamp Information is contained in the register and then the 
5 time stamp is inserted back into the data stream. 

Another embodiment of the invention includes an apparatus described above 
wherein the elementary stream time counters are restricted to 16 bits. 
Likewise, there is an apparatus as described above, wherein the second 
elementary stream time counter located In the elementary stream decoder is 
10 restricted to 18 bits. Furthermore, there is an apparatus as described Bbove 
wherein the synchronization time Is restricted to 16 bits for controlling the 
elementary stream decoder. 

The present invention also has a process for decoding video and for 
determining display time errors against a threshold value. It then parses 
1 5 video data into tokens for further processing, determining If a time stamp 
token is indicated, comparing the time stamp token to a video time, and 
generates a compared value to determine an Indicative of timing error. Next, 
it determines whether the compared value, when compared against a thresh- 
old value, is within acceptable parameters when a timing error is indicated 
2Q and Indicates when the compared value is outside acceptable parameters. 

An alternative embodiment of the invention includes an apparatus 
for using a system decoder and a video decoder. The system decoder is 
adapted to accept MPEG system streams and demultiplexing video data and 
the video time stamp from the stream. The system decoder has a first time 
25 counter representative of system time. The video decoder accepts the video 
data and the video time stamp, and has a second time counter in synchroni- 
zation with the first time counter. The video decoder also has a decoder 
buffer for accepting the video data at a substantially constant rate and 
outputting the video data at a varying rate and for passing a video time stamp. 
30 The video decoder while decoding a picture from the video data also com- 
pares the video time stamp for the decoded picture with the second time 
counter to determine the appropriate display time. There is also a method for 
determining e timing error between a first circuit and a second circuit by 
providing the first circuit with a system time (SY). a time stamp (TS). and an 
35 elementary stream time (ET), obtaining synchronization time (X) by using the 
elementary stream time <ET), the time stamp (TS), and the system time (SY), 
in accordance with the equation X=ET + TS-SY, providing synchronization 
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time (X) to the second circuit and generating a synchronized elementary 
stream time (ET2) and obtaining a timing error by using synchronized time (X) 
and in accordance with the equation ET2-X Hence, the first circuit can be 
time synchronized with the second circuit without passing system time to the 
second circuit. 

Another method tor determining a timing error between a first circuit 
and a second circuit has the following steps: providing the first circuit with a 
time stamp (TS), and an Initial time (IT), obtaining a synchronization time (X) 
by using the time stamp (TS) and the initial time (IT), in accordance with the 
equation X=TS-1 , providing synchronization t'me (X) to the second circuit and 
generating a synchronized elementary stream time (ET) and obtaining a 
timing error by using synchronized time (X) and In accordance with the 
equation ET-X. In this way, the first circuit can be time synchronized with the 
second circuit without passing system time to the second circuit. 

Still another method for determining a timing error between a first 
circuit and a second circuit includes the following steps: providing the first 
circuit with a system time (SY), a video time stamp (VTS), and a video decod- 
ing time (VT), obtaining synchronization time (X) by using the video decoding 
time (VT), the video time stamp (VTS) and the system time (SY), in accor- 
dance with the equation X=VT+VTS-SY, providing synchronization time (X)to 
the second circuit and generating a video decoding time (VT2) in the second 
circuit which is synchronized to the video decoding time (VT) In the first circuit, 
and obtaining a time error by using synchronized time (X) and in accordance 
with the equation VT2-X. Accordingly, the first circuit can be time synchro- 
nized with the second circuit without passing system time to the second 
circuit. 

In accordance with the present invention, the parallel Huffman 
decoder block will decode MPEG Huffman coded Variable Length Codes 
(VLCs) and Fixed Length Codes (FLCs), and pass through tokens under the 
control Df the parser microprogrammable state Machine (MSM), and can 
sustain a high throughput. 

In one embodiment of the invention a code lookup technique is 
employed to decode Huffman codes to achieve performance requirements 
and to handle the second MPEG-2 transform coefficient table which is irregu- 
lar or non-canonical in nature. Practice of the invention also facilitates 
decoding certain more complex components from the stream in a single cycle 
without the assistance of an external controller. Examples of such complex 
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components are Escape-coded coefficients, Infra-DC values and Motion 
Vector deltas, all of which are present in the stream as combined VLC/FLC 



To decode a VLC. input is first taaded intD the two input data 
registers handling most significant and least significant data. A selector is 
used to align the beginning of the next VLC with the ROM input Hence, for a 
very first VLC, the selector outputs the tap 28 bits of Hs 59-bH input and the 
top 16 bits of these are passed to a Huffman Code ROM. For subsequent 
VLCs, the selector effectively shifts the Input according to the total count of 
bits decoded thus far. the count is maintained by adding the size of each 
VLC. as it is decoded, to a running total. The various word widths are a result 
of the maximum coded size which can be decoded, which Is the 28-bit MPEG- 
1 Escape Coded Coefficient, and the maximum VLC size which is 16 bits 
(DCT coefficient tables). 

The "table select" input is used to select between the various 
different Huffman code tables required by MPEG. 

The ROM has addresses which are controlled with a selector/shifter. 
The ROM performs a VLC table index calculation, followed by the index-to- 
data operation that yields decoded data. 

The Index calculation is a content addressable memory (CAM) 
operation with "donl care" matching implemented to handle the Huffman 
codes which form the presented data. Since the index generation is per- 
formed In a look-up manner (rather lhan algorithmically) there is no restriction 
to hand ling tables which are canonical. 

The ROM address of the present invention is in two fields. The 
larger field is the bit-pattern to be decoded, and the smaller field selects which 
Huffman code table is to be examined. In addition to the complete MPEG 
code tables, the ROM also has entries to identify Illegal VLC patterns, which 
exist for some code tables. 

In another embodiment of the invention, a procedure is used for 
providing a word with fixed width, having a fixed number of bits to be used for 
addressing variable width data, and having a width defining field and address 
field. There is also a procedure for addressing memory with a fixed width 
word, having afixed number of bits, to be used for addressing data and 
i having a substitution field and an address field , and an apparatus for address- 
ing memory, including a stale machine and an arithmetic care. 
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The procedure for addressing memory is characterized by providing 
a feted width word having a predetermined fixed number ol bits to be used for 
addressing variable width data, definino the fixed width word with a width 
defining field and an address field, providing the width defining field with at 

5 least one bit to serve as the termination marker, defining the address field with 
a plurality of bits defining the address of data, varying the size of bits in the 
address field in inverse relation to the size of the variable width data, varying 
the number of bits in the width defining field in direct relation to the size of the 
variable width data, and maintaining a fixed width word for addressing vari- 

10 able width data while varying the width of the width defining field and the 
address field. 

The procedure for addressing memory may also include defining the 
address field with a plurality of bits defining the address of the data, defining a 
variable width substitution field with a least one substitution bit, the substitu- 

15 tion field having at least one bit to serve as a termination marker between the 
address field and the substitution field, using the subsiilution field to indicate 
substituted bits from a separate addressing source, and maintaining a fixed 
width word for addressing variable width data while inversely varying the width 
of the address field and the width of the substitution field. 

20 In accordance with the invention, a process for addressing variable 

width data in a memory may be characterized by providing a memory having 
words of predetermined width and composed of partial words, rotating the 
partial word to be accessed to a least significant bit justification, extending the 
remaining pari of the word so that the accessed word will be recognized as a 

25 partial word, restoring the remaining part of the word, and rotating the word 
until the partial wort is restored to its original position. 

The invention may also include a method and apparatus for ad- 
dressing memory wherein a word is provided with fixed width, having a fixed 
number of bits to be used for addressing variable width data, and having a 

30 width defining field and address field. In addition, a procedure for addressing 
memory with a fixed width word, having a fixed number of bits, to be used for 
addressing data and having a substitution field and an address field, may be 
used. 

The invention may also include a method of accessing from RAM a 
35 number M of words that is less than the predetermined fixed burst length N of 
the RAM, the RAM including an enable line 1hat selectably enables and 
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disables reading from and writing to the RAM. the method comprising the 
steps of. 

ordering N words to be read from or written to the RAM; 
determining when M words have been read from or written to the 

RAM, M being less than N; and 
disabling the RAM upon determining M words had been read from or 

written to the RAM. 
The invention may aiso include a method of accessing Dynamic 
Random Access Memory (DRAM) to store and retrieve date words associated 
with a two dimensional image, the DRAM including two separate banks, each 
bank being capable of operating a page mode to read and write the data 
words, the two dimensional image being organized in a two dimensional grid 
pattern of cells, each cell containing an M by N matrix of pixels, and the words 
associated with each cell occupying one page or less of a bank, the method 
comprising the steps of: 

" (a) assigning each cell a particular one of the two banks so that 
all data words associated with that particular cell are read 
from and written to one particular page of that particular bank, 
the assignment of banks to cells being done such that each 
cell is associated with a different bank than any bordering cell 
which is also either in the same row or in the same column; 

(b) reading the data words associated with a cell that is com- 
posed of a matrix of pixels, and that is not aligned with the 
two dimensional grid pattern, but that is aligned with pixels in 
cells in the two dimensional grid pattern. 

(c) identifying which cells in the two dimensional grid pattern 
contain, data words associated with the unaligned cell; 

(d) reading, from the first bank of DRAM, the data words associ- 
ated with one of the cells in the grid pattern Identified as 
containing data words associated with the unaligned cell; 

(e) reading, from the second bank of DRAM, the data words 
associated with another of the cells in the grid pattern identi- 
fied as containing data words associated with the unaligned 
cell; 

(f) repeating steps (d) and <e) until all the data words associated 
with the unaligned cell have been read. 
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The invention may also provide e RAM interface for connecting a 
bus to RAW wherein a separate address generator generates the addresses 
the RAM interface needs to address the RAM. The address generator 
communicates with the RAM interface via a two-wire interface. 
5 The invention may also include a method to control the buffering of 

encoded video data organized as frames or fields. This method involves 
determining the picture number of each incoming decoded frame, determining 
the expected presentation number at any time and marking any buffer as 
ready when its picture number is on or after the presentation number. 

1 o Accordingly. fhose concerned with the desig n, d evelopment, and 

utilization of systems for decoding video data have long recognized the nead 
for enhanced performance as accomplished by the various features of the 
0 present invention. Other objects and advantages of the present invention will 

become apparent from the following more detailed description taken in 

15 conjunction with the accompanying drawings. 
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DETAILED DESCRIPTIONS 

The forthcoming "Detailed Description otthe invention" contains the following 
Sections: 

1) Detailed Description of the Invention for Memory Address- 
ing 

Variable Length Fields Within a Fixed Width Word 

Using Fixed Width Word with Variable Length Fields to Perform 



Addressing Variable Width Data with a Fixed Width Word 
Mlcrocodable State Machine Structure 
Arithmetic Core 

Detailed Description of the Invention for Transforming Data 
using a Common Processing Block 
Theoretical Background of the invention 
Detailed Description of Invention for Time 



4) Detailed Description of the Invention for Asynchronous Swing 
Buffering 

5) Detailed Description of the Invention for Storing Video Informa- 

6) Detailed Description of the Invention for a Parallel Huffman 
Decoder 

The Huffman Code ROM 
Maximizing Throughput 
FLCs and Tokens 
Implementation 

7) MORE DETAILED DESCRIPTION 
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DETAILED DESCRIPTION OF THE INVENTION 

As an introduction to the illustrative embodiments) of the most general 
features of the invention, and referring more particularly to Figure 1 of the 
drawings, the data flow through the preferred embodiment 20G of the nven- 
tton Is shown. The embodiment of the present invention is preferably imple- 
mented using a two-wire pipeline system having various control and DATA 
tokens. The major elements of the system ere a Start Code Detector 201 . a 
Video Parser 202 incorporating a Huffman Decoder 203 and a Microprogram- 
mable State Machine (MSM) 204, an Inverse Discrete CosfcieTransforrn 
<1DCT) 205. a synchronous DRAM controller 206 with an associated address 
generation unit 207. appropriate prediction circuitry 208 and display circuitry 
209 which includes upsampling 210 and 211 and video timing generation 212. 

This application relates to similar subject matter disclosed In British 
Patent Application number 9405914.4 entitled 'Video Decompression" filed on 
March 2-4, 1994, by Discovision Associates, and the latter application Is 
specifically incorporated by reference in this application. 

In accordance with the above, specific aspects, features and 
subsystem areas of the preset invention will be referred to in greater detail 
below. In the drawings, like reference numerals denote like or corresponding 
parts throughout the various drawings and figures. 

Detailed Description of the Invention for Memory Addressing 
In accordance with the present Invention, a method and apparatus for ad- 
dressing memory is described herein. In particular, the present invention 
provides for deferring variable width bit fields with fixed width words. More 
, particularly, the present invention provides a method of addressing variable 
width data with a fixed width word. In various forms of the embodiment, 
variable bit field is used to specify bits to be substituted into the word or to 
specify an unused portion of the word in addressing variable width data with a 
fixed width word. In addition, the system of the present invention includes a 
3 microcodable state machine having an arithmetic core. 

The microcodable state machine is intended to be used for salving 
design problems where there is a need for versatile and/or complicated 
calculations. Examples of such designs include address generation, stream 
parsing and decoding, and filter tap coefficient calculations. In this regard, the 
5 addressing must cope with two different-features: (1) variable length ad- 
dresses to access varying width portions of words and (2) address substitu- 
tion. In the present invention, a RAM having a 64 x 32 bit configuration can 
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be addressed in partial words having 64 x 32 bit, 12B x 16 bit, 256 x 8 bit 512 
x 4 bit, 1024 x 2 bit, or 2048 x 1 bit formats. 
V B ri ffM» ' ftnnfa R » IH » Wlthin a Fi * ad BMto Wortf 
In many applications, it is useful to define variable portions of a word (to be 
6 known as fields) for actions such as substitution, variable width data address- 
ing, or the constriction of other parts of the word. The conventional method 
for defining variable portions of words is to have an additional word (or words) 
Which specify the width of the field (or fields) within the word. In accordance 
with the present invention, a method for encoding this information within the 
1 0 word itself is described. The present method has the advantages of savings 
bits in the overall definition of the word, simplifying decoding of the encoded 
word and providing a more intuitive view of what has been encoded. Further- 
£ more, this encoding method is applicable If the variable width fields are most 

or least significant bit Justified within the word. 
15 Accordingly, Table 1 shows two examples of variable width fields 

(marked "F") that are least significant bit justified defined within an eight bit 
word. A 'V marks other potential fields of these words. 



Table 2 shows the conventional method of encoding the fields shown in Table 
1 using sufficient additional bits to specify the maximum width of the field in 
binary. [Bits marked V are "don't care", i.e. , their value is of no conse- 
quence. This method is clearly inefficient in its use of bits and, furthermore, 
provides a less intuitive form than that described in the present invention. 
Table 2 



The new method, in accordance with the present invention, defines the field 
within the word. This method defines the field by using a continuation marker 
and a termination marker. The field is specified, from one end of the field, as 
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a series of continuation markers followed by a termination marker. In the 
case of a zero length •field, however, only a termination marker is provided at 
the end of the word. Bolh the continuation marker and the termination marker 
are single bits, and they must be complementary, in addition, ihe field must 
be justified to either end of the word. Accordingly, the method of the present 
invention for encoding fields requires a width of only one bit extra over the 
original word width. 

As shown In Table 3, the encoding of the fields shown in the Table 
1, in accordance with the new method, is depicted. In this example, the 
continuation marker is *1* and the termination marker is "0". The field in this 
example is least significant bit justified. 
Table 3 



Bit number (h«x) 



Therefore, the advantages of the encoding method, In accordance with the 
present invention, are: 

1 . A reduction in the number of bits needed in the encoding. 

2. A simplification in the decoding process is required since the need for a 
"x to 1 of " decode of the 'field define" shown in Table 1-2 that would 
normally be required is inherent in Ihe encoding which is already in the 
form of 1 of 2'; and 

3. The encoding is in a more Intuitive form allowing the field defined to be 
more easily identified. 

Furthermore, the use of this encoding method of the present invention can 
also be used such that the termination marker and the continuation marker 
are inverted to provide that the encoding of Table 3 resembles that of Table 4. 
Hence, the use of "1" or"0" is used interchangeably throughout this applica- 



Bit number (hex) 
Fixed word 

Continuation markers 1; 
Termination marker = 0. 
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As previously identified, the field encoded must be justified to eilher end of the 
word. Table 5 illustrates most significant justified fields, i.e.. these are 
encoded in a similar way to least significant bit justified fields except that the 
field reaches from the most significant bit {hereinafter MSB) towards the least 
significant bH (hereinafter "LSB") up to and including the first termination 
marker. The encoding of the fields shown in Table 5 are shown in Table 6. 



10 Table 5 



Termination marker = 



Moreover, fields may be encoded from Ihe least significant and most signifi- 
cant ends of the word simultaneously. For example, the two fields shown in 
Table 7 may be encoded as in Table 8, with the addition of just one bit for 
each field as described previously, 
Table 7 
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l idnn a FtefH Width Word «*r. Variable Length Fields to Perform Address 



There are situations in which "rt is useful to substitute part of a memory 
address by another value. In this way h is possible to construct a data 
dependent address. The encoding method of the present invention can be 
applied to the addresses of a memory to specify what portion of the address 
is to be substituted. If a least sis nlficant bit justified variable length field is 
used in trie address, a substitution field can be defined. For example, a 12 bit 
address Obaaaaaaaaaaaa encoded to have its five least significant bit substi- 
tuted by the 12 bit value Obcccccccccccc would be ObaaaaaaaOl 1 1 1 1 and 
produce the address Obaaaaaaaccccc. Table 9 shows the encoding lor 
substitution into a 12. bit address. 

Table 9: Address substitution 
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One embodiment of the present invention is for addressing a memory which 
can be accessed at te full width or in 2" widths up to its full width (these 
smaller words are called partial words). Hence, it will be Bhown how the 
variable field encoding of the present invention can be used to address this 
memory and to index those addresses into the memory. 

To access a S4 x 32 bit Register file in widths of 32, 16, B, 4, 2 and 1 
bit requires different lengths of address, Le., the Implementation of this 
embodiment is a 64 x 32 bit memory which can be accessed as 64 x 32 bits, 
128x16 bits, 256x6 bits, 512x4 bits, 1024 x 2 bits, or 204B xl bit it is 
seen that 5 bits are required to address one of the 64 x 32 bit locations, while 
12 bits are required to address one of the 2048 x 1 bit locations. Hence, the 
addresses can be of variable length and, in fact, the width of the address 
specifies the address format of the memory. Accordingly, the address can be 
defined within a fixed word width by using a most significant justified variable 
width field which constricts the address and defines its width. This is illus- 
trated In Table 10. 

Table 10: Variable width addressing 



To allow indexing of the address, a portion of it can be substituted using the 
same method described previously for address substitution. The substitution 
portion (or field) of the address can be defined by a least significant bit 
justified variable length field (The continuation marker "1"; termination marker 
"0") that is superimposed on top of those shown in Table 10. Using an 
address of an eight bit word, as an example, Table 1 1 shows how to define 
the number of the least significant bits to be substituted. The least significant 
bit added is the substitution indicator (marked 'V). The general case of a 
Fixed width word for substitution is shewn in Figure 2. 
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Table 11: Address substitution 
Bits to be substituted 



In effect the substitute code is superimposed on top of the address that Is 
already, coded. From this coding, it can be seen that there are illegal ad- 
dresses, most obviously 0x0000 and 0x3fff In this case, a "0" must be in the 
bottom 9 bits to prevent substituting more than 8 bits and a "1" in the top 6 
bits specifies an allowable access width. If one of these errors is detected, 
the access is undefined, but the Register file contents will not be affected. 

In accordance with the present invention, the system for addressing 
and for accessing partial words hi a register file is discussed below. 

The conventional memory circuitry dictates that the memory must 
always be accessed at it full width. To achieve variable width accesses, a full 
(32 bit) width word is read. This full word is rotated until the partial word 
accessed is justified in the LSB. The upper parts of the word are extended to 
the full width and then output. Extending may encompass padding with zeros 
or ones, sign extending, usina the sign bit of a sign-magnitude number as the 
new MSB or any similar conventional method. Extending is dependent on the 
mode of operation. When the partial word is input to and written back into the 
memory, it is multiplexed back into the rotated full word, which is then rotated 
back and written into the array. Figure 3 shows these steps for the access of 
a 4 bit partial word in the fourth four bit word of the 32 bit word. 

To access or read partial words, such as the highlighted four bit word 
shown in row "1" 213 of Figure 3, the fullwidth word must be rotated to place 
the partial word at the LSB, as shown in row "2" 214. As shown in row "3" 
215, the four bit word is extended to create a full 32 bit word. This word can 
now be accessed. 
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As shown in figure 3, a full width word that has been selected to be 
written bade is truncated to the width of the original partial word which is 
multiplexed into the word shown in row "2" 214. At the LSB position, this is 
shown in row "4" 216. The resulting word is rotated back in Us original signifi- 
cance In the read word, this is shown in row "5" 217. This full word can now 
be written back into the register file. 

The following list, therefore, summarizes the steps numbered in Figure 

3: 

1 . Full word read from memory; 

2. 1 2 bit rotated right puts partial word into the LSB; 

3. Extended to full word, then passed to output; 

4. The inputted partial word is multiplexed Into rotated full word from (2); 

5. 12 bit rotated left puts full word back to original state to be written. 
The above accesses suggests the data flow structure of the memory that is 
shownln Figure 4. The numbers in the structure refer to the above text and 
to Figure 3. 

The memory address must be decoded to control the above structure. 
It should be recognized that the MSB of any width of address is at the same 
significance with reference to the memory. The top six bits of a decoded 
address are a 32 bit word address, whereas the remainder Is a bit address. 
Therefore, the stage of decoding (in parallel with the substitution) is to decode 
the address width defining variable field by detecting the position of the most 
significant termination marker, This allows the address to be MSB justified 
(shifting in zeros at the LSB). The top six bits can be used directly as a 32 bit 
word row address of the memory. The bottom five bits can be used to 
directly control both barrel shifters (as seen in Figure 4), because, for exam- 
ple, an original 32 bit address will always have a shift of ObOOOOO (these 
having been shifted when the address was MSB Justified). Similarly, a 16 bit 
address can have a shift of ObxOOOO. i.e.. 0 or 16 bit shift and a 1 bit address 
can have a shift erf Obxxxxx, i.e., Dto 31 bit shifts. The extender and input 
multiplexer are controlled by the access width decode to mask out the output 
words and multiplex the Input words to an appropriate significance, respec- 
tively. The block diagram of the decode is shown in Figure 5. it can be seen 
that the decode of the two variable width fields for width and substitution can 
be done In parallel and independently. 
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Figure 2 illustrates an example of a fixed width word 13 bits long for 
addressing variable width data and substitution as shown in the bottom two 
rows. For these examples, an eight bit word would have been addressed at 
location ObHOIssss, where "ssss" Is substituted from another address source. 



In accordance with the present Invention, the substitution into a memory 
address and the variable width accessing of a memory have been brought 
together in the Implementation of a microcodable state machine the structure 
of which is shown in Figure 6. The structure is one of a stale machine 218 
providing control of an arithmetic core 21 9 by way of a wide word of control 
signals called a microcode instruction. The arithmetic core 219, in turn, 
passes status flags and some data to the state machine 21 B. 

The state machine 218, in accordance with the present invention, 
includes a memory containing a list of the microcode instructions. As with 
conventional microcodable state machines, it is capable of either proceeding 
through the list of microcode instructions contiguously or a jump can occur 
from one instruction to another. The jump address is in the form shown in 
Figure 7. The substituted value comes from the Arithmetic core 218 as shown 
in Figures 6 and B. This allows the construction of "jump tables" within the 
microcode programs. Thus, if a jump is made with 3 bits substituted, for 
example, there are eight possible contiguous locations that may be jumped to, 
each dependent on the value from the arithmetic core, i.e., It has so become 
a programmable jump. 

Arithmetic Core 

The arithmetic core 21 9. as shown in Figure 8, includes a memory called a 
register file 221 , an Arithmetic and Logic unit (ALU) 222, an input port 223 
and an output port 224. These components are connected via buses and 
multiplexers. As previously stated, these components, and the multiplexers 
defining their connections, are entirely controlled by the microcode instruction 
issued by the state machine 218. The ALU 222 and the ports 223 and 224 
are conventional, however, the register file 221 is a memory which allows 
variable width indexed accesses. The addresses to the register file 221 is 
coded directly Into the miciocode instruction. 

There 8re many advantages of using this method of addressing to the 
register file. First, many locations in an -application do not need to be the full 
width of the memory (32 bits in this case). Whilst it will cause no effect on the 
operation of the device to use a full width location, it is very wasteful of 
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memory locations. Minimizing the number of memory locations will minimize 
the amount of space used by the memory and, therefore, minimize the 
capacftlve loading, in the register file. This maximizes the speed of the 
register file. Second, the indexing combined with the variable width of 
5 memory accessing allows the stepping through of locations of variable width. 
In the one bit case this allows an elegant implementation of long division and 
multiplication. 

In summary, therefore, there is described a procedure for addressing 
memory having the following steps: (1) providing a fixed width word having a 
10 predetermined fixed number of bits to be used for addressing variable width 
data; (2) defining the fixed width word with a width defining field and an 
address field providing the width defining field with at least one bit to serve as 
^ a termination marker; (3) defining the address field with a plurality of bits 

defining the address of the data; and (4) varying the size of bits in the address 
15 field in inverse relation to the size of the variable width data varying the 
number of bits in the width defining field in direct relation to the size of the 
variable width data and maintaining a fixed width word for addressing variable 
width data while varying the width of the width defining field and the address 
field. In addition, a procedure for addressing memory having ihe following 
20 steps is described: (1 ) providing a fixed width word having e predetermined 
fixed number of bits to be used for addressing data; (2) defining the fixed 
width word with an address field and a substitution field; (3) defining the 
address field with a plurality of bits defining the address of the data; (4) 
defining a variable width substitution field with at least one substitution bit; (5) 
0 25 the substitution field has at least one bit to serve as a termination marker 

between the address field and the substitution field; and (6) using the substi- 
tution field to indicate substituted bits from a separate addressing source and 
maintaining a fixed width word for addressing variable width data while 
inversely varying the width of the address field and the width of the substitu- 
30 tion field. In addition, a process for addressing variable width data in a 

memory is described as having the following steps: (1) providing a memory 
having words of predetermined width and composed of partial words; (2) 
rotating the partial word to be accessed to a least significant bit justification; 
(3) extending the remaining part of the word so that the accessed word will be 
35 recognized as the partial word; and (4) restoring the remaining part of the 
word and rotating the word until the partial word is restored to its original 
position. 
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Detailed Description of the Invention for Transforming Data Using a 
Common Processing Block 

This present embodiment, in accordance with the present invention, relates 
to a method for the transformation of signals from a frequency to a time 
5 representation, as well as a digital circuit arrangement for implementing the 
transformation. 

It is a common goal in the area of telecommunications to increase both 
information content and transmission speed. Each communications medium, 
however, imposes a Dmltation on transmission speed, as does the hardware 
10 at the transmitting and receiving end that must process the transmitted 

signals. A telegraph wire is, for example, typically a much faster medium for 
transmitting information than the mail is, even though it might be faster to type 
9 and read a mailed document than to tap out a telegraph key. 

The method of encoding transmitted Information also limits the speed 
1 5 at which information can be conveyed. A long-winded telegraph message will, 
for example, fake longer to convey than a succinct message with the same 
information content. The greatest transmission and reception speed can 
therefore be obtained by compressing the data to be transmitted as much as 
possible, and then, using a high-speed transmission medium, to process the 
20 data at both ends as fast as posstole. which often means the reduction or 
elimination of 'bottlenecks' in the system. 

One application in which it is essential to provide high-speed transmis- 
sion of large amounts of data is in the field of digital television. VMhereas 
conventional television systems use analog radio and electrical signals to 
0 25 control the luminance and color of picture elements ('pixels') in lines displayed 
on a television screen, a digital television transmission system generates a 
digital representation of.an Image by conveying analog signals into binary 
'numbers' corresponding to luminance and color values for the pixels. Modem 
digital encoding schemes and hardware structures typically enable much 
30 higher information transmission rates than do conventional analog transmis- 
sion systems. As such, digital televisions are able to achieve much higher 
resolution and much more life-like images than their conventional analog 
counterparts. It is anticipated that digital television systems including so- 
called High-Definition TV (HDTV) systems, will replace conventional analog 
35 television technology within the next decade in much of in the industrialized 
world. The conversion from analog to digital imaging, for both transmission 
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and storage will, thus, be similarto the change-over from analog audio 
records to the now ubiquitous compact discs (CD's). 

In order to increase the general usefulness of digital image technology, 
standardized schemes for encoding digital images have been adopted. Once 
5 such standardized scheme is known as the JPEG standard and is used for 
still pictures. For moving pictures, there are at present two standards. MPEG 
and H.261, both of which carry out JPEG-like procedures on each of the 
sequential frames of the moving picture. To gain advantage over using JPEG 
repeatedly, MPEG and H.261 operate on the differences between subsequent 
10 frames, taking advantage of the well-known fact that the difference, that is, 
the movement between frames, is small. It, therefore, takes less time or 
space to transmit or store the information corresponding to thB changes rather 
than to transmit or store equivalent still-picture information as If each frame in 
the sequence were completely unlike the frames closest to it in the sequence. 
1 5 For convenience, all the current standards operate by breaking an 

image or picture into tiles or blocks, each block consisting of a piece of the 
picture eight pixels wide by eight pixels high. Each pixel is then represented 
by three (or more) digital numbers known as 'components' of that pixel. There 
are many different ways of breaking a colored pixel into components, for 
20 example, using standard notation, e.g., YUV. YCr. Cb, RGB, etc. All the 
conventionalJPEG-like methods operate on each component separately. 

It is well known that the eye is insensitive to high-frequency compo- 
nents (or edges) in a picture. Information concerning the highest frequencies 
can usually be omitted altogether wiihout the human viewer noticing any 
25 significant reduction in image quality. In order to achieve this ability to reduce 
the information content In a picture by eliminating high-frequency information 
without the eye detecting any loss of information, the 8-by-8 pixel block 
containing spatial information (for example, the actual values for luminance) 
must be transformed in some manner to obtain frequency information. The 
30 JPEG, MPEG and H.261 standards all use the known Discrete Cosine 
Transform to operate on the 8-by-8 spatial matrix to obtain an 8-by-8 fre- 
quency matrix. 

As described above, the input data represents a square area of the 
picture. In transforming the input data into the frequency representation, the 
35 transform that is applied must be two-dimensional, but such Two-dimensional 
transforms are difficult to compute efficiently. The known, two-dimensional 
Discrete Cosine Transform (DCT) and the associated inverse DCT (lDCT), 
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however, have the property of being "separable". This means that rather than 
having to operate on all 64 pixels in the eight-by-eight pixel block at one time, 
the block can first be transformed row-by-row into intermediate values, which 
are then transformed column-by-column Into the final transformed frequency 
5 values. 

A one-dimensional DCT of order N is mathematically equivalent to 
multiplying two N-by-N matrices. In orderto perform the necessary matrix 
multiplication for an eight-by-eight pixel block, 512 multiplications and 448 
additions are required, so that 1,024 multiplications and 896 additions are 

10 needed to perform the full 2 dimensional DCT on the 8-by-8 pixel block. 
These arithmetic operations, and especially multiplication, arc complex and 
slow and. therefore, limit the achievable transmission rate. They also require 
0 considerable space on the silicon chip used to Implement the DCT. 

The DCT procedure can be rearranged to reduce the amount of 

15 computation required. There are, et present, two main methods used for 
reducing the computation required for the DCT, both of which use "binary 
decimation". The term 'binary decimation" means than an N-by-N transform 
can be computed by using two N2-by-N2 transformations, plus some compu- 
tational overhead whilst arranging this. Whereas the eight-by-eight transform 

20 requires 512 multiplications and 448 additions, a four-by-four transform 

requires only 64 multiplications and 48 additions. Binary decimation, thus, 
saves 284 multiplications and 352 additions and the overhead incurred in 
performing the decimation is typically Insignificant compared to the reduction 
in computation. 

a 25 At present, the two main methods for binary decimation were devel- 

oped by Eong Gi Lee ("A New Algorithm to Compute the DCT) IEEE Transac- 
tions on Acoustics, Speech and Signal Processing, Vol. Assp 32, No 6, p 
1243 December 1384) and Wen-Hsiung Chen CA Fast Computational Algo- 
rithm for the DCT, Wen-Hsiung Chen, C. Harrison Smith, S C Pralick. IEEE 
30 Transactions on Communications, Col. Com 25, No. 9 1004, September 

1 977). Lee's method makes use ot the symmetry inherent in the definition of 
the inverse DCT and, by using simple cosine identities, it defines a method 
for recursive binary decimation. The Lee approach is only suitable for the 
IDCT. 

35 The Chen method uses a recursive matrix identity that reduces the 

matrices into diagonals only. This method provides easy binary decimation of 
the DCT using known identities for diagonal matrices. 
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A serious disadvantage of the Lee and Chen methods is that they are 
unbalanced in respect of when multiplications and additions must be per- 
formed. Essentially, both of these methods require that many additions be 
followed by many multipBeatlons, or vice versa. When implementing the Lee 
or Chen methods in hardware, it is. therefore, not possible to have parallel 
operation of adders and multipliers. This reduces their speed and efficiency 
since the best utilization of hardware is when an adders and multipliers are 
used all the time. 

An additional disadvantage of such known methods and devises for 
performing OCT and 1DCT operations Is that it is usually difficult to handle the 
so-called normalization coefficient, and Known architectures require adding an 
additional multiplication time when all the multipliers are being usBd. 

Certain known methods for applying the forward and Inverse DCT to 
video data are very simple and highly efficient for a software designer who 
need not be concerned with the layout of the semiconductor devices which 
perform the calculations. Such methods, however, often are fartoD slow or 
are too complex in semiconductor architecture and hardware interconnections 
to perform satisfactorily at the transmission rate desired for digital video. 

Yet another shortcoming of existing methods and hardware structures 
for performing DCT and IDCT operations on video data Is that they require 
floating -poinl internal representation of numerical values. To illustrate this 
disadvantage, assume that one has a calculator that is only able to deal with 
three - digit numbers, including digits to the right of the decimal point (if any). 
Assume further that the calculator is 1o add the numbers 12.3 and 4.55 
(Notice that the decimal point is not fixed relative to the position of the digits in 
these two numbers. In other words, the decimal point is allowed to 'float'). 
Since the calculator is not able to store the four digits required to fully repre- 
sent the answer 16.86, the calculator must reduce the answer to three digits 
either by truncating the answer by dropping the right-most yielding an 
answer of 16.8, or it must have the necessary hardware to round the answer 
up to the closest three-digit approximation 16.9. 

As this very simple example illustrates, if floating-point arithmetic is 
required, one must eilher accept a loss of precision or include highly compli- 
cated and space-wasting circuitry to minimize rounding error. Even with 
efficient rounding circuitry, however, the-accumulationand propagation of 
rounding or truncation errors may lead to unacceptable distortion in the video 
signals. This problem is even greater when the methods for processing the 
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video signals require several multiplications, since floating point rounding and 
truncation errors are typically greater for multiplication than for addition. 

A much more efficient DCTflDCT method and hardware structure 
would ensure that the numbers used In the method could be represented with 

5 a fixed decimal point, but in such a way that the full dynamic range of each 
number could be used. In such a system, truncation and rounding errors 
would either be eSminated or. at least, greatly reduced. 

in the above example, if the hardware can handle four digits, no 
number greater than 99,99 were ever needed, and every number had the 

1 0 decimal point between the second and third places, then the presence of the 
decimal point would not affect calculations at all. Accordingly, the arithmetic 
could be earned out just as if every number were an integer, e.g., the answer 
0 1230+0456=1686 would be just as dear as 12.30+4.56=16.86, since one 

would always know that the '1686' should have a decimal point between the 

1 S middle '6' and '8'. Alternatively, if numbers (constant or otherwise) are 

selectively scaled or adjusted so that they all fall within the same range, each 
number in the range couldls ao be accurately and unambiguously represented 
as a set of integers. 

One way of reducing the number of multipliers needed is simply to 

20 have a single multiplier that is able to accept input data from different sources. 
In other words, certain architectures use a single multiplier to perform the 
multiplications required in different steps ol the DCT or OCT calculations, 
Although such "crossbar switching" may reduce the number of multipliers 
required, it means that large complicated multiplexer structures must be 
0 25 included instead to select the Inputs to the multiplier, to isolate others from the 
multiplier, and to switch the appropriate signals from the selected sources to 
the inputs of the multiplier. Additional large-scale multiplexers are also 
required to switch the large number of outputs from the shared multipliers to 
the appropriate subsequent circuitry. Crossbar switching or multiplexing is, 

30 therefore, complex, is generally slow (because of the extra storage needed) 
and costs are significant in a final semiconductor implementation. 

Still another drawback of existing architectures, including the "crossbar 
switching" is that they require general purpose multipliers. In other words, 
existing systems require multipliers for which both inputs are variable. As is 

35 well known, implementations of digital multipliers typically Include rows of 
adders and shifters such that. If the current bit of a multiplier word is a 'one' 
the value of the multiplicand is added into the partial result, but not if the 
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current bit is a 'zero'. Since a general purpose multiplier must be able to deal 
with the case in which every bit is a '1', a row of adders must be provided for 
every bit of the multiplier word. 

By way of example, assume that data words are B bits wide and that 
5 one wishes to multiply single Inputs by 5. An 9-bit representation of the 

number 5 is 00000101. In other words, digital multiplication by 5 requires only 
that the Input value be shifted to the left two places (corresponding to multipli- 
cation by 4) and then added to its up-shifted value. The other six positions of 
the coefficients have bit values of '0', sd they would not require any shifting or 

10 additional steps. 

A fixed-coefficient multipBer, that is, in this case, a multiplier capable of 
multiplying only by five, would require only a single shifter and a single adder 
in order to perform the multiplication (disregarding circuitry needed to handle 
carry bits). A general purpose multipBer, in contrast, would require shifters 

15 and adders for each of the eight positions, even though six of them would 
never need to be used. As the example illustrates, fixed coefficients can 
simplify the multipliers since they allow the designer to eliminate rows of 
adders that correspond to zeros in the coefficient, thus saving silicon area. 
In an IDCT method, in accordance with the present invention, a one- 

20 dimensional IDCT for each N-row and N-column of N-by-N pixel blocks is 
decimated and a 1-D IDCT is performed separately on the N-2 even-num- 
bered pixel input words and the N-2 odd-numbered pixel input words. 

In a preferred embodiment, N=8 according to the JPEG standard. The 
two-dimensional IDCT result is then obtained by performing two one-dimen- 

25 sional IDCT operations in sequence (with an intermediate reordering- 
transposition-ofdata). 

In a common processing step, for N=8, a first pair of input values is 
passed without need for multiplication to output adders and subtracters. Each 
of a second pair of input values is multiplied by each of two constant-coeffi- 

30 cient values corresponding to two scaled cosine values. No other multiplica- 
tions and only one subtraction and one addition are required in the common 
processing step. The second pair is then added or differenced pairwise with 
the first pair of input values to form even or odd resultant values. 

In a pre-common processing stage, the lowest order odd input word is 

35 pre-multiplied by the square root of two and the odd input words are summed 
pairwise before processing in the common processing block. In a post- 
common processing stage, intermediate values corresponding to the pro- 
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cessed odd input words are multiplied by predetermined constant coefficients 
to form odd resultant values. 

After calculation of the even and odd resultant values, the N/2 high- 
order outputs are formed by simple subtraction of the odd resultant values 
from the evBn resultant values, and the N/2 low-order outputs are formed by 
simple addition of the odd resultant values and the even resultant values. 

For bolh the DCT (at the transmission end of a video processing 
system) and the IDCT (at the receiving end, which incorporates one or more 
of the various aspects of the present invention), the values are preferably and 
deliberately scaled downward by a factor of two by a simple binary right shift. 
This deliberate, balanced, upward scaling eliminates several multiplication 
steps that are required according to conventional methods. 

According to another aspect of the method, in accordance with the 
present invention, selected bits of constant coefficient or intermediate result- 
ing data words are rounded or adjusted by predetermined setting of selected 
bits to either T or '0*. 

Two-dimensional transformation of pixel data is carried out by a 
second, identical 1-D operation on the output values from the first 1-D IDCT 
processing steps. 

An IDCT system, according to yet another aspect of the present 
invention, includes a pre-common processing circuit, and a common process- 
ing circuit, in which the pre-common. common, and post-common processing 
calculations are performed on input data words. A supervisory controller 
generates control signals to control the loading of various system latches; 
preferably, to serially time-multiplex the application of the N/2 even and N/2 
odd-numbered input words to input latches of the pre-common block tD direct 
addition of the even and odd resultant values to form and latch low order 
output signals and to direct subtraction of the odd resultant values from the 
even resultant values to form and latch the high-order output signals and to 
sequentially control internal multiplexers. 

In the present invention, even and odd input words are preferably 
processed in separate passes through the same processing blocks. Input 
data words are preferably {but not necessarily) latched, not in strictly ascend- 
ing or descending order, but rather in an order enabling an efficient 'butterfly' 
structure for the data path. 

Furthermore, at least the common processing circuit may be config- 
ured as a pre-logic circuit, with no clock or control signals required for its 
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proper operation, as may be other processing blocks, depending on the 
particular application. 

No general-purpose multipliers (with two variable inputs) are required. 
Rather, constant coefficient multipliers are Included throughout the preferred 
embodiment. Furthermore, fixed-point integer arithmetic devices are included 
In the preferred embodiment of the invention and can be so designed as to 
provide a method and system for performing IDCT transformation of video 
data with one or more of the following features: 

1 . Constant use of all costly arithmetic operations; 

2. In order to reduce the sSicon area needed to Implement the IDCT, 
there are a small number of storage elements (such as latches), 
preferably no more than required for efficient pipelining of the architec- 
ture, coupled with 3 small number of constant coefficient multipliers 
rather than general purpose multipliers that require extra storage 
elements; 

3. Operations are arranged so that each arithmetic operation does not 
need to use sophisticated designs, for example, if known 'ripple adders' 
are used, these would allow sufficient time to 'resolve' (see below) or 
produce their answers; if operations are arranged in such a way that 
other devises precede the rearranging operations so as to avoid delay 
and to allow greater throughput and efficiency; 

4. One is able to generate results in a natural order; 

5. Na costly, complex, crossbar switching is required; 

6. The architecture is able to support much faster operations; and 

7. The circuitry used to control the flow of data through the transform 
hardware can be smaD In area. 

T h eore ti cal B a ckground of th e I nve nti on 
In order to understand the purpose and function of the various components 
and the advantages of the signal processing method used in the IDCT system 
according to the present invention, it is helpful to understand the system's 



.Separabilit y . of a Two-Dimensional IDCT 

The mathematical definition of a twD-dimensional forward discrete cosine 
transforms (DCT) for an N x N block of pixels is as follows, where U(j,k) are 
the pixel frequency values corresponding to the pixel absolute values X(m,n) 
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Equation 1: 



where j.k=0,1...,N-1 and 
c((),c(l}.1/^ ro/-/,JW>; otherwise 1 

^ 5 The terms 2N govern the dc level of the transform, and the coefficients 

e{j), c{k) are known normalization factors. 

The expression for tha corresponding inverse discrete cosine trans- 
form, that is for the IDCT, is as follows: 

Equation 2: 



where j,k=0 N-1 and 

15 cftrfkyvfi) fir j,k . 0; o*«n»i» 1 

The forward DCT is used to transform spatial values (whether representing 
characteristics such as luminance directly, or representing differences, such 
as in the MPEG standard) inlo their frequency representation. The inverse 
20 DCT, as its name implies, operates the other 'direction', that is, the IDCT 
transforms the frequency values back into spatial values. 

In the expression, Equation 2, ( E2), note that the cosine functions 
each depend on only one of the summation indices. 

The expression E2 can therefore be rewritten as: 



iffH¥8- 1 7 2 6 2 4 



This is the equivalent of a first one-dimensional IDCT performed on the 
product of all terms thai depend on k and n. followed, after a straightforward 
standard data transposition by a second one-dimensional IDCT using as 
inputs the outputs of the first IDCT operation. 
Pfifinition of the i-o, idct 

A 1-dimensional N-point IDCT (where n is an even number) is defined by the 
fallowing expression. 
Equation 4: 

X (A) ■ £ c (n) • y (if) ws j 110 ^ "j * ■ <0,1 /V-1) 



c (n) - 1/(v^) for n-0; otherwise 1 

and where y(n) are the N inputs to the inverse transformation function and 
x{k) are its N outputs. As in the 2-D case, the formula for the DCT has the 
same structure under the summation sign, but with the normalization constant 
outside the summation sign and with the x and y vectors switching places in 
the equation. 

Resolution of a 1-D IDCT 
As is shown above, the 2-D IDCT can be calculated using a sequence of 1-D 
IDCT operations separated by a transpose. In accordance to one embodi- 
ment, each of these 1-D operations is ,in turn, broken down into sub-proce- 
dures that are then exploited to reduce even further the required size and 
complexity of the semiconductor implementation. 
NQrmsijzgtiprt of Coefficients 

As is discussed above, an important design goal for IDCT hardware is the 
reduction of the required number of multipliers that must be included in the 
circuitry. Most methods for calculating tire DCT of IDCT, therefore, attempt to 
reduce the number of multiplications needed. According to this embodiment, 
however, all the input values are deliberately scaled upward by a factor of the 
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square root of two. In other words, using the method according to this 
embodiment of the present invention, the right-hand side of the IDCT expres- 
sion (E) is deliberately multiplied by the square root of two. 

According to this embodiment, two 1-D IDCT operations are performed 

5 in series (with an intermediate transpose) to yield the final 2-D IDCT result 
Each of these 1-D operations includes a multiplication by the same square 
root of two factor. Since the intermediate transposition involves no scaling, 
the result of two multiplications by the square root of two in series is that the 
final 2-D results will be scaled upward by a factor two. To obtain the un- 

10 scaled value, the circuitry need then only divide by two. Since the values are 
all represented digitally, this can be accomplished easily by a simple right shift 
of the data. As is made clearer below, the upward scaling by the square root 
^ of two in each 1-D IDCT stage and final down-scaling by 2 is accomplished by 

adders, multipliers and shifters all within the system's hardware, so that the 

15 system places no requirements for scaled inputs on the other devises to 

which the system may be connected. Because of this, the system is compati- 
ble with other conventional devises that operate according to the JPEG or 
MPEG standards. Normalization according to this embodiment of the present 
invention, therefore, eliminates the need for hardware multipliers within the 

20 IDCT semiconductor architecture for at least two square root of two multiplica- 
tion operations. As is explained below in greater detail, the single additional 
multiplication step (upward scaling by the square root of two) of the input data 
in each 1-D operation leads to the elimination of still other multiplication steps 
that are required when using conventional methods. 
£ 25 Separation of the 1-D IDCT into Hioh and L ow-Order Outputs 

Expression E can now be evaluated separately for the N/2 low-order outputs 

(k=0, 1 N/2-1) and the N/2 high order outputs (k=N/2, k=N/2 + 1....N). For 

N=8, this means that one can first transform the inputs to calculate y(0), y(1), 
y(2) and y(3), and then transform the inputs to calculate y(4), y(5), y(6) and 

30 y(7). 

Introduce the variable tf=(N-1-k) for the high-order outputs (k=N/2+1 

N), so that k' varies from (N/2-1) to N as k varies fm ro(N/2+1) to N. For N=8, 
this means that k'=(3,2,1,0) for k=(4,5,6,7). It can then be shown that expres- 
sion E can be divided into the following two subexpressions E5 (which is the 
35 same as E except for the inlerval of summation) and E6: 
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Low order outputs: 
Equation 5: 




where k={0.1....{N/2-1»; and 
c (n) - 1/y5 for n -0; otherwise 1 

5 High-order outputs: 
Equation 6: 

x (*) . x (AM-*-) -£yW | n 

where k={N (NE+lfl-H^RI (N/2-1)} 

(Since c(n)=1 for all high-order terms, c(n) is not included in this expression) 

Note that both E5 and E6 have the same structure under the summation 

10 sign except that the term <-1)n changes the sign of the product under the sum- 
mation sign for the odd-numbered inputs (n odd) for the upper N2 output values 
and except that the y term will be multiplied by c (O) - 1^/2. 
Se paration of the 1-D IDCT into Even and Qdcl I nputs 
Observe that the single sum in the 1-D IDCT expression E4 can also be sepa- 

1 5 rated into two sums: one for the even-numbered inputs (for N=8 y(O), y(2), 

y(4),and y(6) and one for the odd-numbered inputs (for n=8. y(1). y(3). y(5). and 
y(7). Let s(k) represent the partial sum for the even-numbered inputs and h{k) 
represent the partial sum for the odd-numbered inputs. 
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Thus: 

Equation 7. 



[(*)■£ o (2n) y (2n) cos [ "^ 2/1 ) ■ E M2n) y (2n> o 



where k=(0.1.... .(N/2-1)}. 
For N=8, observe that the sums in E7 and E8 both are taken over 
n={D,l£,3}. 

Now recall the known cosine identity. 

2.cosA.cosB=cos(A+B)+cos(A-B), 

and sef A • n (2My2W and B - n (2fc1 )|2AM )/2W. 

One can then multiply both sides of the expression EB by: 

2. cos A - 1/ {2 cos[ n (2/MV2/YI ] -Ck. 

Note that, since Ck does not depend on the summation index n, it can be moved 
within the summation sign. Assume then by definition that y(-1)=0, and note that 
the cosine function for the input y(7) is equal to zero. The expression for h(k) 
can then be rewritten in the following form: 

Equation 9. 

h (Jr ) _J r £ [y (2n-1 ). y P/I.1HCMI n ' 2K - 1 i" ) 



Where k=(0,1 <N/2-1)J. 

Note that the inputs [y(2n+1)-y(2n-1)] imply that in calculating h(k), the 
odd input terms are paired to form N/2 paired inputs p(n)=[y(2n+1)=y(2n-1)]. 



fthH¥8- 1 7 2 6 2 4 



For N=8 the values of p(n) are as follows: 



n 


P(n) 


0 


y(-D + Y(1) = Y(1) Y(-1) - 0 by definition 


1 


y(D + y(3) 


2 


y(3) + y(5) 


3 


y(5) + y[7) 



Expression E9 forh{k) can then be represented by the following: 
Equation 10. 

h « ■ C, fc p M cosliie^J 
2 1$ 



Where k=(0,1 (N/2-1)}. 

Observe now that the cosine term under the summation sign is the same 
for both g(k) and h(k) and that both have the structure of a 1-D IDCT (compared 
with expression E5). The 

result of the IDCT for the odd k terms, that is, for h(k), however is multiplied by 
the factor 

Ck=1/{2.cos [ n {2kA)IZN. 

In other words, g(k) is an n/2-point IDCT operating on even inputs y(2n) 
and h(k) is an n/2-point IDCT operating on [y(2n+1)-y(2n-1)] where y(-1)=0 by 
definition. 

Now introduce the following Identities: 
yn.y(n)\ 
cf-eos(n8); 

c2-cos(2ne}-cos(Ti4)-1 .Jl ; 

c.3.cos(3rT8) ; 

£».1[2.cos(tt1610)]; 

d3.1[2.cos(3n/16)]; 

e/5=1[2.cos(5n/16)];and 

o7.1/[2.cos(97n/16)]. 

Further introduce scaled cosine coeefficients as follows: 
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c3sV£cos(3n8); 

Using the evenness (cos(-$).t»s(<}5)}and periodicity 
(cos ( -4 ))n ( - t|>) - - cos (4>) of the cosine function, expressions E7 and 
E8 can then be expanded for N=8 to yield (recall also (O) is 1/y5); 

otO>1A/Iy 0 , y2c1 . y4c2 * y6c3 . 1/,/2.f> • /2.c/s * y4 . y6.c3s) 
g(l).1A/5.yO . y2c3 - y4c2 - y6c1 • [yO * y2.c3s • y4 - y6.efe) 
, y6.cls) 

g(3) ■ 1V5 .yO - y2cf , y4c2 - y6c3 - Vjl. (yO - y2.cte * y4- y6.c3s) 
and 

h{0) - o*f. {y* - (yt - y3) cf .(y3 » y5) c2 . {y5 . y7)c3} = 
d#V§.{v5.yf ♦ (y* ♦ y3). cte < (y3 . y5) . (y5 . y7).e3s} 

• <J3.{y1 + {y1 * y3) c3 - {y3 - y5) c2 . {y5 . y7) cf} - C3/V5. 
{V2.yr * (yf , y3) c3s - (y3- yS) - (y5 - y7) ds) 

h(2) - d5.{yf * y3) c3 - (y3 - y5> c2 * (y5 . y7) d) . d5/^. 
{v^.yr~ <y1 . y3). c3ys - (y3* * yS) - (y5 . y7) cfs} 
ft(3) - o7. { y? - (K* « y 3 ) c1 * (y3 * y5) c2 - (y5 . y7) c3 } . d7lJZ. 

{J2.y1 - (y1 ♦ y3). ds . (y3* yS) - 0* . y7}s c3s } 

Now, recall that according to this embodiment of the present invention, ail values 
are scaled upward by a factor of 2 for both the DCT and IDCT operations. In 
other words, according to the embodiment, both h(k) and g(k) are multiplied by 
this scaling factor. The g(k) and h(k) expressions, therefore, become: 
Equation 11. 3(0) . yO * y2 • ds * y4 * yS ■ c3s 
g(1) - yO - y2 . c3s - y4 - y6 • c3s 
g{2) * yO - y2 - c3s - y4 . y6 . ds 
and g (3) . yO - y2 . els ♦ y4 - y6 ■ c3s 

Equation 12. 

h{0) ■ d1 • y1 * (y1 ■ y3) . ds . {y3 . y5) . <y5 . y7) . c3s] 
- d3 lj2 . y1 • (yl • y3) . c3s - [y3 - yS) - (/5 - y7) . cfs] 
/i{2) . ds tV5 ■ yf - ryt - y3> . c3s - (y3 - y5) . Cy5 . yT) . ds] 
/j(3) - 07 [>/2 . yl - (y1 - y3) - ds - [y3 - y5) - (y5 - /7) - c3s] 
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AS 

Notice that since c2 - cos (n /4) - 1 V2, multiplication by V5 gives a scaled 
c2 vaiue«1. By scaling the expressions (corresponding to upward scaling of the 
values of the video absolute and frequency values) according to this embodi- 
ment, K is, therefore, possible to eliminate the need to multiply and c3s, both of 
5 which are constant coefficients so that general utility multipliers are not needed. 
This, in turn, eliminates the need for the corresponding hardware multiplier In the 
semiconductor gnptementatlon of the IDCT operations. 

The similarity in structure of g(k) and hM can be illustrated by expressing 
these sets of equations in matrix form. Let C be the 4 x 4 cosine coefficient 



1 ds 1 c3s 

1 c3s -1 -cm 

1 -«3s -1 els 

1 -els 1 -c3s 



1 0 matrix defined as follows: 
Equation 13. 
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Where D= diag[d1, d3, d5, d7}=the 4x4 matrix with d1, d3, d5, and d7 along the 
diagonal and with other elements equal to zero. As E14 and E15 show, the 
procedures for operating on even-numbered inputs to get g(k) and for operating 
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on the odd-numbered inputs to gel h(k) both have the common step of multiplica- 
tion by the cosine coefficient matrix C. To get h(k), however, the inputs must first 
be pairwise summed (recalling that y(-1)=0 by definition), y(1) must be 
premultiplied by 2, and the result of the multiplication by C must be multiplied by 
S D. 

As the expressions above also indicate, the N-point, 1-D IDCT (see E4) 
can also be split into the two N/2-point. I-D IDCTs each involving common core 
operations (under the summation sign) on the UI2 odd (grouped) and the N/2 
even Input values. The expressions above yield the following simple structure for 
1 0 the IDCT as Implemented in this embodiment 
Low-order outputs for (N=B. outputs k=f0,1,2,3}): 
Equation 16. 
• y(k)=g(k]+h(k) 

High-order outputs (for N=8, outputs k={4,5,6,7}): 
15 Equation 17. 

y(k)=y(N-1-k , )=g(k , )-h(k') 

Note that g(k) operates directly on even input values to yield output values 
directly, whereas hfJO involves grouping of Input values, as well as multiplication 
by the values d1, d3. d5 and d7. 
20 As always, thdee signer of an IDCT circuit is faced with a number of trade- 

offs, such as size versus speed and greater number of implemented devices 
versus reduced interconnection complexity. For example, it is often possible to 
improve the speed of computation by including additional, or more complicated 
devices on the silicon chip, but this obviously makes the implementation bigger 
£ 25 or more complex. Also, what is available or desired on the IDCT chip may limit 
or preclude the use of sophisticated, complicated, designs such as "look-ahead" 
adders. 

fflanriards of Accuracy 

Assuming infinite precision and accuracy of all calculations, and. thus, unlimited 
30 storage space and calculation time, the Image recreated by performing the IDCT 

and DCT-transformed image data would reproduce the original image perfectly. 

Of course, such perfection is not to be had using existing technology, 

In order to achieve some standardization, however, IDCT systems are at 

present measured according to a standardized method put forth by the Comite 
35 Consultatif International Telegraphique et Telephonique fCCIT) in 'Annex 1 of 
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CCITT Recommendations H.261 - Inverse Transform Accuracy Specification.' 
This test specifies that sets of 10.000 8-by-8 Blocks containing random integers 
be generated. These blocks are then OCT and IDCT transformed (preceded or 
followed by predefined rounding, clipping and arithmetic operations) using 
predefined precision 10 produce 10.000 sets of B-by-8 'reference' IDCT output 

8 ' When testing an IDCT implementation, the CCITT test blocks are used as 
inputs. The actual IDCT transformed outputs are then compared statistically with 
the known 'reference' IDCT output data. Maximum values are specified for the 
IDCT in terms of peak, mean, mean square, and mean mean error of blocks as a 
whole and as individual elements. Furthermore, the IDCT must produce all zeros 
output if the corresponding input block contains all zeros, and the IDCT must 
meet the same standards when the sign of all input data is changed. Implemen- 
tations of the IDCT are said to have acceptable accuracy only If their maximum 
errors do not exceed the specified maximum values when these tests are run. 

Other known standards are those of the Institute of Electrical and Elec- 
tronic Engineers ("IEEE"), in 'IEEE Draft Standard Specification for the Implemen- 
tation Of 8 by 8 Discrete Cosine Transform', P118Q/D2. July 18, 1990; and Annex 
A of '8 by 8 Inverse Discrete Cosine Transform'.. ISO committee Draft CD 1 1 172- 
2. These standards are essentially identical to the CCITT standard described 
above. 

tfcri forare Imp lementation 
FIG 9 is a simplified block diagram illustrating the data flow of the IDCT method 
according to one embodiment of the present invention (although the hardware 

. structure, as is illustrated and explained below, is made more compact and 
efficient). In FIG 9. the Inputs to the system such as YI0] and Y[4], and the 
outputs from the system, such as X[3] and X[6). are shown as being conveyed on 
single lines. It is to be understood that each of the single-drawn lines In FIG 9 
represents several conductors in the form of data buses to convey, preferably in 

) parallel , the several-bit wide data words to which each input and output corre- 
sponds. 

In FIG 9, the large open circles 225 and 226 represent two-input adders, 
whereby a small circle 227 at the connection point of an input with the adder 
indicates that the complement of the corresponding input word is used. Adders 
5 with such a complementing input, thus, subtract the complemented input from 
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the non complemented input. For example, although the output TO from the 
upper left adder will be equal to YIO) + Y[4] that Its. TO = YO + Y4, the adder with 
the output T1 forms the value YO + (-1),* Y4=Y0 - Y4. Adders with a single 
complementing input can, therefore, be said to be differencing components, 
5 Also in FIG 9, constant-coefficient multipliers are represented by solid 

triangles 230 in the data path. For example, the input Y1 passes through a 
square root of two multiplier before entering the adder to form BO. Consequently, 
the Intermediate value T3=Y2.T3>=Y2.c1S + Y6.c3s, end the intermediate value 
B2 ■ pl.c3s-p3.c1 s=(Y1 +Y3).c3s - (Y5+Y7).c1 s. By performing the indicated 
10 additions, subtractions, and multiplications, one will see that the illustrated 
structure implements the expressions E1 1 and E12 for g(0) to g(3) and h(0) to 
A h£3). 

W FIG 9 illustrates an important advantage of the embodiment, in accor- 

dance with the present Invention. As FIG s shows, the structure is divided into 
15 four main regions: a pre-common block, PREC 231 . that forms the paired 
inputs p(k) and multiplies the input y(1) by the square root of two; a first post- 
common block, POSTC1 233. that includes four multipliers for the constants dl, 
d3, dS, d7 (see expression E12}; a second post-common block, POSTC2 235. 
that sums the gO to g3 terms and the hO to h3 terms for the low order outputs. 
20 and forms the difference of the gO to g3 terms and the hO to h3 terms for the 

high-order outputs (See expressions E17 and E17); and a common block, CBLK 
232, is included in both the even and odd data paths. In the processing circuitry 
according to the embodiment of the present invention, the common operations 
performed on the odd and even numbered inputs are carried out by a single 

£ 25 structure, rather than duplicated structure as Illustrated in FIG 9. 

To understand the method of operation and the advantages of certain 
digital structures used in the embodiment, it is helpful to understand what "carry 
bits". As a simple example, note that the addition of two binary numbers Is such 
that 1 + 1=0, with a carry of "1", which must be added into the next higher order 
30 bit to produce the correct result "10"' (the binary representation of the decimal 
number "2"). In other words. 01 + 01 = 00 (the "sum" without carry) + 1 0 (the 
carry word); adding the "sum" to the 'carry word"' one gets the correct answer 00 
+ 10 = 10. 
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As a decimal example, assume that one needs to add the numbers '436' 
and '825-. The common procedure for adding two numbers by hand typically 
proceeds as follows: 

1 Units '6* plus '5' is T with a carry of T Into the tens' position - 
5 Sum: 1 , Carry-in: 0. Carry-Out: 0. 

2. Tens: '3' plus '2' is V, plus the '1' carried from the preceding step, gives '6' 
with no carry- 
Sum: 5. Carry-In: 0. Carry-Outd. 

3, Hundreds: '4' plus's' is '2* with a carry of 1 into the thousands, but with no 
10 carry to he added in from the previous step; 

Sum: 2, Carry-In:). Carry-Out1 
4_ Thousands: '0' plus •0', plus the '1' carried from the hundreds gives. '1' 
^ Sum: 0. Carry-In: 1, Carry-Out 0. 

The answer, '1261'. is, thus, formed by adding the carry-in sum for each 
1 5 position to the sum for the same position, with the carry-in to each position being 
the carry-out of the adjacent lower-order position. (Note that this implies that the 
carry-in to the lowest order position is always a '0'). The problem, of course, is 
that one must wait to add the r and '8' in the hundreds place until one knows 
whether there will be a carry-in from the tens place. This illustrates a "ripple 
20 adder", which operates essentially in this way. A ripple adder, thus, achieves a 
final' answer without needing extra storage elements, but it is slower than some 
other designs. 

One such alternative design is known as 'carry-save', in which the sum of 
two numbers for each position is formed by storing a partial sum or result word 
f 25 (in this example, 0251) and the cany values in a different word (here, 1010). The 
full answer is then obtained by 'resolving' the sum and carry words in a following 
addition step, thus, 0251 + 1010 = 1261 . Note that one can perform the addition 
for every position at the same time, without having to wait to dotermine whether a 
carry word can be added to the partial result at any lime as long as It is saved. 
30 Since the resolving operations typically require the largest proportion of 

the time required in each calculation atage, speeding up these operations has a 
significant effect on the overall operating speed while requiring only a relatively 
small increase In the size of the transform. Carry-save multipliers, therefore, 
are usually faster than those that use ripple adders in eech row. However, this 
35 gain in time comes at the cost of greater'complexity, since the carry word for 
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each addition in the multiplier roust be either stored or passed down to the next 
addition. Furthermore, in order to obtain the final product of a multiplication, the 
final partial sum and final carry word will have to be resolved, normally by 
addition in a ripple adder. Note, however, that only Dne ripple adder will be 
■ 5 nee d«d ( so that the time savings are normally proportional to the size of the 
multiplication thai must be performed. Furthermore, note lhat a carry word may 
be treated as any other number to be added in and as long as it is added in at 
some time before the -final multiplication answer is needed, the actual addition 
can be delayed. 

10 In this embodiment of the present invention, this possibility of delaying 

resolution is used to simplify the design and to increase the throughout of the 
IDCT circuitry. Also, certain bite of preselected carry words are, optionally and 
w deliberately forced to predetermined values before resolution in order to provide 

greater expected accuracy of the IDCT result based on a statistical analysis of 
1 5 test runs of the Invention on standard test data sets. 

FIG 10 is a block diagram that illustrates a preferred structure, in accor- 
dance with the present invention. In this preferred embodiment of the present 
invention, the even and odd numbered inputs are time-multiplexed end are 
processed separately in the common block CBLK 232. The inputs may be 
20 processed in either order. 

In FIG 10, the notation Y[1.0], Y[5,4), Y[3,2] and Y[7,6) is used to indicate 
that the odd numbered inputs Y1. Y3. Y5, Y7 preferably pass through the 
calculation circuitry first, followed by the even numbered inputs Y0, Y2, Y4, Y6. 
This order is not essential to the present embodiment; nonetheless, as Is ex- 
£ 25 plained below, certain downstream arithmetic operations are performed only on 
the odd numbered inputs, and by entering the odd numbered input values first, 
these downstream operations can be processing at the same time that arithmetic 
operations common to all inputs are performed upstream on the even numbered 
inputs. This reduces the time that several arithmetic devices would otherwise 
30 remain idle. 

Similarly, the notation X[0,7), X[1 ,6], X[3,4], X[2,5] is used to indicate that 
the low order outputs X0, X1. X2. X3 are output first, followed by the high order 
outputs X4, X5, X6, X7. As FIGS. 9 and 10 illustrate, the inputs are preferably 
initially not grouped in ascending order, although this is not necessary since to 
35 odd numbered inputs are Y1 , Y5, Y3. and Y7. Arranging the input signals in this 
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order mates possible the simple ■butterfly' data path structure shown in FIGS. S 
and 10 and greatly increases the interconnection efficiency of the implementation 
of the present invention in silicon semiconductor devices. 

As shown in FIG 1 0, addeis and subtracters are Indltecad by circles either 
5 a (adder ) 235. - (subtractor ) 236 which is an adder with one complementing 
input or '£ (resolving adder/subtractor, which is able to switch between addition 
and subtraction 237). The left most adders and subtracters in the common block 
232 of the two m-bit input words is the nvbit partial resulting parallel with the m- 
bh or (m-1 ) bit word containing the carry bits of the add-on/subtraction. In other 
10 words, the first additions and subtractions In the common block CBLK 232 are 
preferably unresolved, meaning thai the addition of the cany bits is delayed until 
a subsequent processing stage. The advantage of this step is that such carry- 
41 save adder/subtracters since they do not need to perform the final addition of the 

carry-bit word to the result. Resolving adders may, however, also be used in 
15 order to reduce the bus width at the outputs of the adders. 

FIG 10 also illustrates the use of one and two input latches in the pre- 
ferred embodiment of the present invention. In FIG 10, latches are Illustrated as 
rectangles 238 and are used in both the pre-common block PREC 231 and the 
post-common block POSTC 233. Single-input latches are used at the inputs of 
20 the multipliers D1 , D3, D5 and D7. as well as to latch the inputs to the resolving 
adders/subtractors which are the computed g(k) and h(k) values corresponding 
to the respective outputs from latches g[0,7], g[1,6], g[3,4] and g[2,5] and ht0,7], 
h[1,6J, h[3,4] and h[2.5]. As such, the resolving adders/ subtracters perform the 
addition or subtraction indicated in expressions E16 and E17 above. 
A 25 As described previously, the even-numbered inputs Y0 , Y2, Y4 and Y6 do 

not nBed to be paired before being processed in the common block CBLK 232. 
However, not only do the odd-numbered inputs require such pairing, but the input 
Y12 must also be multiplied by the square root of two in order to ensure that 
proper input values are presented to the common block CBLK 232. The pre- 
30 common block PREC Z31 , therefore, includes a 2-input multiplexing ('mux') latch 
C10, C54, C32 and C76 for each input value. One input to the 2-input mux latch 
is consequently tied directly to the unprocessed input values, whereas the other 
input is received from the resolving adders and, for the input Y1, the resolving 
square root of two multiplier. The correct paired or unpaired inpuls can, there- 
35 fore, be easily presented to the common -block CBLK 232 easily by simple 
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switching of the multiplexing latches between their two inputs. 

As FIG 10 illustrates, the square root of two multipliers D1, D3, D5, D7 
preferably resolve their outputs, thai is, they generate results in which the cany 
bits have been added in to generate a complete sum. This ensures that the 
5 outputs from the multipliers have the same bus width as the un-multiplled inputs 
in the corresponding parallel data paths. 

The preferred embodiment of the common block 232. in accordance with 
the present invention, also includes one •dummy" subtractor240 in the forward 
data path tor Y[1.0] and YIS.4], respectively. These devices act to combine the 
10 two inputs (in the case of the dummy subtracter, after Zs-complementing the one 
input) in such a way that they are passed as parallel outputs. In each case, the 
one input is manipulated as if it contained carry bits, which are added on in the 
^ subsequent processing stage. The corresponding addition and subtraction is, 

thus, performed, although It Is delayed. 
15 This technique reduces the resources required in the uppertwo data 

paths since a full-6cal8 adder/subtracter need not be implemented for these ■ 
devices. Therefore, the 'combiners' act as adders and subtractors and can be 
implemented for these devices and can be implemented either as simple conduc- 
tors to the next device [for addition), or as a row of inverters (for subtraction), 
20 either of which req uires little or no additional circuitry. 

The use of such combiners also means that the outputs from the initial 
adders and subtractors in the common block CBLK 232 will all have the SBme 
width and will be compatible with the outputs of the carry-save adder/subtractor 
found in the bottom two data paths , with which they form inputs to the subse- 
0 25 quent resolving adders and subtractors in the common block CBLK. 

As described previously, the even-numbered inputs are processed 
separately from the odd-numbered inputs in this preferred embodiment of the 
present invention. Assume, further, that the odd-numbered inputs are to be 
processed first. Supervisory control circuitry (not shown in FIG 10) applies the 
30 odd-numbered input words to the pre-common block PREC. and selects the 
lower inputs (viewed as in FIG 10) of the multiplexing latches C10, C54, C32, 
C76 which then stores the paired values pO to p3 (see FIG 9 and the definition of 
p(n) above). The latches 1h0. 1h1. 1h3 and Ih2 are then activated to latch the 
values HO, Ht, H3 and H2, respectively. 
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The supervisory control circuitry latches and then selects the upper inputs 
of tie two-input muSiplexing latches C10, C54, C32 and C76 in the precommon 
block PREC 231 and applies the even numbered input words to these latches. 
Since the even-numbered inputs are used to form the values of gO to g3, the 
5 supervisory control circuitry also opens the latches LgD to Lg3 in the post- 
common block POSTC 233, to store the g(k) values. 

Once the g{k) and h(k) values are latched, the post-common block 
POSTC 233 outputs the high-order signals X7, X6. X5 and X4 by switching the 
resolving adder subtracters to the subtraction mode. The low order output 

10 signals X3. X2. X1 and X0 are then generated by switching the resolving ad- 
ders/subtracters to the addition mode. Note that the output data can be pre- 
sented in an arbitrary order, including natural order. 
0 The preferred multiplexed implementation, in accordance with the present 

invention, is illustrated in greatly simplified, schematic form in FIG 10, performs 

15 the same calculations as the non-multiplexed structure illustrated in FIG 6. The 
number of adders, subtractors and multipliers in the common block CBLK 232 is, 
however, cut in half and the use of dummy adder/subtradors 240 further reduces 
the complexity of the costly arithmetic circuitry. 

FIG 1 1 illustrates the main components and data lines of an actual 

20 implementation of the IDCT circuit according to the embodiment of the present 
invention. The main components include the precommon block circuit PREC 
231 , the common block circuit CBLK 232, and the post-common block POSTC 
233. The system also includes a controller CNTL 241 that either directly or 
indirectly applies input, timing and control signals to the precommon block PREC 
£ 25 231 and post-common block POSTC 233. 

In the preferred embodiment of the present invention, the input and output 
signals (YO to Y7 and XO to X7, respectively) are 22 bits wide. Tests have 
indicated that this is the minimum width that is possible which still yields accept- 
able accuracy as measured by existing industry standards. As is explained in 

30 greater detail below, this minimum width in achieved in part by deliberately 

forcing certain carry words in selected arithmetic devices to be either a '1' or a V. 
This bit manipulation, corresponding to an adjustment of certain data words, is 
carried out as the result of a statistical analysis of the results of the IDCT system, 
in accordance with the present invention, to the after using the IDCT transfor- 

35 mation of known input test data. By forcing certain bits to predetermined values, 
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H was discovered thai the eftects of rounding and truncation errors could be 
reduced, so that the spatial output data from the 1DCT system could be made to 
deviate less from the known •correct* spatial data. The present invention is 
equally applicable, however, to other data word lengths since the components 
5 used in the circuit according to the present embodiment can all be adapted to 
different bus widths using known methods. 

Althouflh all four inputs that are processed together could be input 
simultaneously to the pre-common block PREC along 68 parallel conductors (4 x 
22), pixel words are typically converted one at a time from the transmission data. 
10 According to the present embodiment, input data words are, therefore, preferably 
all conveyed serially over a single 22 bit input bus and each input word is 
sequentially latched at the proper input point in the data path. As shown in FIG 
# 11, the 22 bit input data bus is labelled T_IN[21:0] 242. 

In the Figures and in the discussion below, the widths of multiple-bit 
1 5 signals are indicated in brackets with the high-order bit to the left of a colon ':' 

and the'least significant bit (LSB) to the right of the colon. For example, the input 
signal T IN|21:0] 242 Is 22 bits wide, with the bits being numbered from 0 to 21. 
A single bit is identified as a single number within square brackets, thus. TJNf.1] 
indicates the next to least significant bit of the signal TJN. 
20 The following control signals are used to control the operation of the pre- 

common block PREC 231 in the preferred embodiment of the present invention. 

IN CLK, OUT_CLK: The system, in accordance with the present inven- 
tion, preferably uses a non-overlapping two phase clock. The signals IN_CLK 
and OUT_CLK are accordingly columns of latches that hold the values of input, 
£ 25 intermediate, and output signals. 

W LATCH10, LATCH 54, LATCH32. LATCH76: Preferably, one 22-bit word is 

input to the system at a time. On the other hand, four Input signals are pro- 
cessed at a time. Each input signal must, therefore, be latched at its appropriate 
place in the architecture before being processed with three other input words. 

30 These latch signals are used to enable the respective input latches. The signal 
LATCH54, for example, is first used to latch input signal Y5 and later to latch 
input signal Y4, which enters the pre-common block PREC 231 al the same point 
as the inpul signal Y5 (see FIG 10) but during a subsequent processing stage. 
LATCH: Once the four even or odd-numbered input signals are latched 

35 into the pre-common block PREC 231 , they are preferably shifted at the same 



(270) 



WP8- 1 7 2 6 2 4 



55 

time to a subsequent column of latches. The signal LATCH is used to enable a 
second column of input latches that hold the four input values to be operated on 
by the arithmetic devices in the pre-common block PREC 231. 

SEL BYP, SEL_P: As FIG 10 illustrates, the even-numbered input 
5 signals Harare latched into the latches C10, C54, C32 and C76 should be those 
that bypass the adders and the square roct of two resolving multiplier. The odd- 
numbered input signals, however, must first be paired to form the paired inputs 
p(n), and the signal Y1 must be multiplied by the square root of two. The control 
signal SEL_P is activated in order to select the paired input signals. Hence, 
1 0 these signals are used to control gates that act as multiplexers to let the correct 
signals pass to the output latches of the precommon block PREC 231 . 

As discussed previously, not having to arrange the inputs in strictly 
^ ascending order leads to a simplified 'butterfl/ bus structure with high intercon- 

nection efficiency. As also described, the odd inputs are preferably applied as a 
15 group to the pre-common block first, followed by the even-numbered inputs, but 
any order may be used within each odd or even group, i.e., any order of inputs 
may be used, however, suitable latch arrangements as separately provided to 
process the odd-numbered inputs, or at least are provided in separate regions of 
the circuit, 

20 The supervisory control circuitry also generates timing and control signals 

for the post-common block POSTC 233. These control signals are as follows: 

EN_BH. EN_GH: Referring again to FIG 9, the outputs from the common 
block CBLK232, after processing of the odd-numbered inputs, are shown as HO, 
H1 , H3, and H2. These signals are then sent to the coefficient multipliers, d1 , 
0 25 d3, d7, d5, respectively, in the first post common block POSTC 1 233. The signal 
EN_BH is used to enable latches that hold the go to g3 values, as well as to 
enable the latches that hold the hO to h3 values after they have been multiplied 
in the coefficient multipliers. 

ADD, SUB: As FIG 10 illustrates, the embodiment includes a bank of 
30 resolving adders/subtractors that sum and difference(k) and h(k) values in order 
to form the low-order outputs, respectively. The signals ADD, SUB are used to 
set the resolving adders/subtractors in the addition and subtraction modes, 
respectively. 

EN_0: This signal is used to enable output latches that latch the results 
35 from the resolving adders/subtractors. - 
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MUX_OUT70, MUX_OtfT61. MUX_OUT43, MUX_OUT52: In accordance 
with the present invention, the output data from the system Is preferably transmit- 
ted over s single 22-bit output bus, so that only one output value (XO to X7) is 
transferred at a time. These signals are activated sequentially to select which of 
5 the four latched output values is to be latched into a final output latch. Accord- 
ingly, these signals thus act as the control signals for a 4-to-1 multiplexer. 

' T_OUT[21:0): This label indicates the 22-bit output signal from the post- 
common block POSTC 233. 

The output signals from the pre-common block PREC 231 are latched to 
10 form the input signals to the common block CBLK 232. As shown in FIG 11, the 
output signals from the pre-common block PREC 231 are presented as the four 
22-bit data words CI10[21:0], CI54I21:0], C132{21:0J, Cl76[2t:0], which become 
the input signals IN[0], INfl], IN[3], INp], respectively, to the common block 
CBLK 232. 

15 As FIG 11 shows, the four 22-bit results from the common block CBLK 

232 are' transferred in parallel as output signals OUT0[21:0). OUT1 [21:0]. 
OUT3[21:0], OUT2[21:0], which are then latched as the input signals of the post- 
common block POSTC 233 as CO70[20;1], COS1[21:0), CO43[21:0), 
CO52[21:0]. 

20 One should take particular note that no control signals are required for the 

common block CBLK. Because of the unique structure of the IDCT system in 
this example, the common block of the system's operations can be performed as 
pure logic operations, with no need for clock, timing or control signals. This 
further reduces the complexity of the device. One should also note that in 

25 certain applications (particularly those in which there Is plenty of time to perform 
all needed arithmetic operations) the pre-common and post-common blocks 
PREC 231, POSTC 233 may also be arranged to operate without clock timing or 
control signals. 

FIG 12 is a block diagram of the pre-common block PREC 231 Df the 
30 present invention. In this and following Figures, the notation 'S1 [a], 

S2|b],...,SM[Z]', where S is an arbitrary signal label and a,b z are integers 

within the range of the signal's bus width, indicates that the selected bits a, b 

z from the signals S1 , S2 SM are transferred in parallel over the same bus, 

with the most significant bits (MSBs) being the selected bits 'a' of the signal S1 , 
35 and the least significant bits (LSBs) being the selected 'z' of signal SM. The 
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selected bits do not have to be individual bits, but rather, entire or partial multi-bit 
words may also be transmitted along with other single bits or complete or partial 
multi-bit words. In the Figures, the symbol S will be replaced by the correspond- 
ing signal label. 

5 For example, in FIG 12, a square root of two multiplier is shown as 

R2MUL. The 'save'; or 'unresolved sum* output from this non-resolving multiplier 
is indicated as the 21-blt word M5SI20:0], similarly, the 'cany output from the 
multiplier R2MUL is shown as the 22-bit word M5C[2D:0], which is transferred 
over the bus to the 'b' input of a carry-save resolving adder M5A. (Recall that a 
10 "0' Is inserted as an MSB to the least significant 21 bits of the save output, 

however, Ihis is accomplished before being applied to the 'a' input of the resolv- 
ing adder M5A. This is indicated in FIG 12 by the notation GND.M5S{20;0]). In 
other words the conductor corresponding to the MSB Input to the adder M5A is 
forced to be a '0' by tying it to ground GND. 
1S in order to understand why a '0' is inserted as the 22'nd bit of the 'sum', 

observe that if the partial sum of a multiplication is n places wide, the carry word 
is shifted one place to Ihe left relative to the partial sum. The carry word, 
therefore, extends to n + 1 places with a valid data bit in the n + 1th position 
with an '0' in the least significant position (since there is nothing before this 
20 position to produce a carry bit intD the units position). If these two words are 

used as inputs to b resolving binary adder, care must be taken to ensure that the 
bits (digits) of the carry word are property aligned with the corresponding bits of 
the partial sum. This also ensures that the decimal point (even if only implied, as 
in integer arithmetic) is kept 'aligned' in both words. Assuming the inputs to the 
25 adder are n + 1 bits wide, a '0' can then be inserted into the highest-order bit of 
all n-blt positive partial sum words to provide an n+ 1 bit Input that Is aligned with 
the carry word at the other input. 

As is described above previously, the four inputs that are processed at a 
given time In the pre-common block PREC 231 are transferred over the input bus 
30 T_1N(21 :0). This input bus is connected to the inputs of four input latches IN10L, 
IN54L, IN32L, AND IN76L Each respective latch is enabled only when the input 
clock signal IN_CLK and the corresponding latch selection signal LATCH 10, 
LATCH54, LATCH32, LATCH76 are high. The four inputs can, therefore, be 
latched into their respective input latches in four periods of 1he IN_CLK signal by 
35 sequential activation of the latch enabling signals LATCH10, LATCH54, 
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LATCH32, and LATCH76. During this time, the LATCH signal should be low (or 
on a different phase) to enable the input latches 1N10L, IN54L, 1N32L, and 1N7BL 
to stabilize and latch the four input values. 

An example of the timing of the latches, In accordance with the present 

5 invention, is illustrated in FIG 1 3. Once the four input sis nals are latched In the 
preferred order, they are passed to a second bank of latches L10L, L64L, L32L, 
176L. These second bank of latches are enabled when the signals OUT_CLK 
and LATCH are high. This signal timing is also illustrated in FIG 13. 

Note that the system of the present invention does not have to delay 

1 0 receipt of all eight Input words. Once all the even or odd input words are re- 
ceived and latched in IN10L, IN54L, 1N32L and L76L, this frees the In latches, 
which can then begin to receive the other four input signals without delay at the 
next rising edge of IN_CLK. 

The 2-digit suffix notation [10, 54. 32, 76] used forthe various components 

15 illustrated in the Figures indicates that odd-numbered signals are processed first, 
followea by the even-numbered signals on a subsequent pass through the 
structure. As is mentioned above, this order is not required by the present 
invention, and it will be appreciated by one of ordinary skill in the art that addi- 
tional orders may be used. 

20 Once the four Input signals are latched in proper order In the second set of 

latches L10L, L54L, L32L, L76L, the corresponding values are either passed as 
inputs to output latches C10L. C54L, C32L and C76L on activation of the 
selected bypass signal SEL_BYP. or they are passed as paired and multiplied 
Inputs to the same output latches upon activation of the 'select p' signal SEL_P. 

25 In other words, all signals are passed, both directly and indirectly, via arithmetic 
devices, to the output latches C10L, C54L, C32L, C76L of the pre-common block 
PREC 231. The proper-values, however, are loaded into these latches by 
activation of the 'select bypass* signal SEL.BYP (for even-numbered inputs YO, 
Y2, Y4, and Y6) or the "select p" signal SEL-P (for the odd-numbered inputs Y1 , 

30 Y3, Y5 and Y7). As will be appreciated by one of ordinary skill in the art, the 
desired timing and order of these and other control signals is easily accom- 
plished in a known manner by proper configuration and/or [micro-] programming 
of the controller CNTL241, 

The uppermost input value at the output of latch L10L is passed first to the 

35 square root of two-multiplier R2MUL andlhen to the resolving adder M5A as 



(274) 



1 7 2 6 2 4 



59 

indicated. The output from the resolving adder M5A Is shown as an equivalent of 
the resolved multiplication of the output from the latch L1 OL by the square root of 
two. The outputs from the other three latches L54L, L32L, L7BL are also trans- 
ferred to corresponding output latches C54L, C32L and C76L, respectively, both 
5 directly via 22-blt latch buses LCH54I21:0), LCH32I21:0] LCH76[21 :0] and 

indirectly to the output latches via resolving adders P2A, P1 A and P3A, respec- 
tively. 

In the present invention, each resolving adder P2A, P1A, P3A has two 
inputs "a" and "b". For adder, P2A, the one input is received from the latch L32L, 
10 and the other input is received from the latch L54L. For input values Y5 (latched 
in L54L) and Y3 (latched In L32L), the output tram the adder P2A will, therefore, 
be equal to Y5 + Y3, which, as is shown above, is equal to p(2). Hence, the 
™ adders "pair the odd-numbered inputs to form the paired input values p(1), p(2) 

and p(3). Of course, the even-numbered input signals latched in L54L, L32L, 
15 and L76L will also pass through the resolving adders P2A, P1A and P3A, 

respectively, however, the resulting p "values" will not be passed to the output 
latches C54L, C32L and C76L because the "select p" signal SEL_P will not be 
activated for even-numbered inputs. 

The values that are latched in the output latches C10L, C54L. C32L and 
20 C76L upon activation of the Input clock signal IN_CLK will therefore be equal to 
either the even-numbered inputs YO, Y2, Y4, Y6 or the paired input values PO, 
P1.P2.P3 for the odd-numbered inputs. One should recall that the input Y(1 ) is 
"paired" with the value U(-1), which is assumed to be zero. As illustrated in FIG 
12, this assumption is implemented by not adding anything to 1he value Y1. 
£ 25 Instead, Y1 is only multiplied by the square root of two as is shown in FIGS. 9 
and 10. 

FIG 14 illustrates the preferred architecture of the common block CBLK 
232, in accordance with the present invention. Because of the various multiplica- 
tions and additions in the different system blocks, il is necessary or advanta- 
30 geous to scale down the input values to the common block before performing the 
various calculations. This ensures a uniform position for the decimal point (which 
is implied for integer arithmetic) for corresponding inputs to the various arithmetic 
devices in the system. 

Accordingly, the input values IN0[21:0] AND IN1[21:0] are accordingly 
35 scaled down by a factor of four, which corresponds in digital arithmetic to a right 
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shift of two bits. In order to preserve the sign of trie number (keep positive 
values positive and negative values negative) in binary representation, the most 
significant bit (MSB) must then be replicated in the two most significant bits of the 
resulting right-shifted word; this process is known as "sign extension". Hence, 

5 the input value INO is downshifted by two bits with sign extension to form the 
shifted input value indicated as IN[21], IN0[21], IN0[21:2). The input value 
IN1f.21:0] is similarly sign-extended two places. The input 1N2 is also shifted and 
extended to form 1N2[21], IN2[21:1). These one-position shifts correspond to 
truncated division by a factor of two. 

10 Asshownin FIG 10, the input IN2, IN3 are those which must be multiplied 

by the scaled coefficients c1s and c3s. Each input IN3 and IN2 must be multi- 
plied by each of the 3caled coefficients. As FIG 1 4 illustrates, this is imple- 
mented by the four constant-coefficient carry-save multipliers MULC 1 S, 
MULNC1S, MULC3S3. and MULC2S2. One should note thai the bottom 

15 multipliers IN2 is an inverting multiplier MULCIS, that is, its output corresponds 
to the negative of the value of the input multiplied by the constant C1S. There- 
fore, the value latched in C76 is subtracted from the value latched in C32 (after 
multiplication by CSS). By providing the inverting multiplier MULNC1S, subtrac- 
tion is implemented by adding the negative of the corresponding value, which is 

20 equivalent to forming a difference. This allows the use of identical circuitry for 
the subsequent adders, while allowing a non-inverting multiplier may be used 
with a following subtractor. 

In the illustrated embodiment of the present Invention, four cosine coeffi- 
cient multipliers MULC1 S, MULNC1S. MULC2S3, and MULC3S2 are included. If 

25 arrangements are made for signals to pass separately through the multipliers, 
however, the necessary multiplications can be implemented using only two 
multipliers, one for the c1s coefficient and one for the c3s coefficient. 

In accordance with the present invention, the multipliers for MULC1S, 
MULNC1S, MUL3S3 and MULC3S2 are preferably of thB carry-save type, which 

30 means that they produce two output words, one corresponding to the result of 
the various rows of additions performed within a hardware multiplier, and another 
corresponding to the carry bits generated. The outputs from the multipliers are 
then connected as inputs to either of two 4-input resolving adders BT2, BT3. 
For ease of illustration only, five of the output buses from the multipliers 

35 are not drawn connected to the corresponding input buses of the adders, as will 
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be appreciated by one of ordinary skill in the art. these connections are to be 
understood, and are illustrated by each respective output and input having the 
same labeL Hence, the save output M1S[20:0] of the multiplier MULC1S is 
connected to the lower 21 bfts of the "save-a" of the adder BT3. 
5 As shown in FIG 14, five of the inputs lo the adders BT2 and BT3 are 

shown to being "split". For example, the "ea" input of the adder BT2 is shown as 
having IN3[21] over f/3CJ20:0] being Input as the least significant 21 bits. 
Similarly, the "sa" (the "save-a" input) of the same adder is shown as being QND, 
GND over M3S[19:0], This means that two zeros are appended as the two most 

10 significant bits of this Input word. Such appended bits ensure that the proper 22- 
bit wide input words are formed with the proper sign. 

The carry-save adders BT2 and BT3 add the carry and save words of two 
different 22-btt Inputs to form a 22-blt output save word T3S[21 :0] and a 21-bit 
output carry word T3C[21:1]. Accordingly, the input to each adder is thus 68 bits 

15 wide and the output from each adder is 43 bits wide. As FIG 1 0 illustrates, the 
output from the latch C10 is combined with the output from the latch C54 in the 
upper-most data path before addition with the output from the carry-save adder 
BT3. The "combination" is not, however, necessary until reaching the following 
adder in the upper data path. Consequently, as FIG 14 shows, the shifted and 

20 sign-extended input value INO is connected to the upper carry input. 

The upper carry input of adder CSO Is connected to the shifted and sign- 
extended input value INO, and the shifted and sign-extended input IN1 is con- 
nected as the upper save input of the same adder. In other words, INO and INI 
are added later in the adder CSO. 

25 The designation "dummy" adder/subtractor 240 used in FIG. 1 0, therefore, 

indicates which operation must be performed, although It does not necessarily 
have to be performed at the point indicated in FIG. 10. Similarly, the lower 
dummy subtractor 240 shown in FIG. 10 requires that the output from latch C54 
be subtracted from the output from latch C1Q. This Is the same as adding the 

30 output from C10 to the complement of the output of C54. 

Referring once again to FIG. 14, the complement of the input IN1 (corre- 
sponding to the output of latch C54 in FIG 10) is performed by a 22-bit input 
inverter IN1(21:0] (which generates the logical inverse of each bit of its input, bit- 
for-bit). The complement of IN1 value-NIN1[21:0]-is passed to the upper "save" 

35 input of the adder CS1 , With the corresponding upper "carry" input being the 
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shifted and sign-extended INO. The upperportion of the adder CS1, therefore, 
performs the subtraction corresponding to IND minus IN1 . 

In the lower two data paths shown in FIG. 10, resolving subtracters are 
used instead of the resolving adders shown in the upper two data paths at the 
5 output of the common block CBLK232. Each resolving adder or subtractor is 
equivalent to a carry-save adder or subtractor followed by a resolving adder, 
This is shown In FIG. 14. Subtracters CS2 and CS3 have as their inputs the 
processed values of INO to INS according to the connection structure shown In 
FIG. 10. 

10 The 22-blt carry and save outputs from each of the adders/subtractors 

C20-CS3 are resolved in the resolving adders RESD-RES3. As will be appreci- 
ated by one of ordinary skill in the art, resolution of carry and save outputs is well 
understood In the art of digital design and Is, therefore, no1 described in greater 
detail here. As FIG. 14 illustrates, the save outputs the carry-save ad- 

15 ders/subtraetors CS0-CS3 are passed directly as 22-bil inputs to the n a"-input of 
the corresponding resolving adders RES0-RES3 

As is also well known In the art, the 2's-complement of a binary number is 
formed by inverting each of its bits (changing all "1's" to "O's" and vice versa) and 
then adding "1". Note that the "1" can ba added immediately after the bit inver- 

20 slon, or later. The LSB of a carry word will always be a "0" which is implemented 
in the illustrated embodiment of the present invention by tying the LSB of the 
carry words O0C and 01C to ground GND as they are input to the resolving 
adders RES0 and RES1, respectively. The addition of "1" to the carry outputs of 
the subtracters CS2 and CS3 to form 2'S-complemenied values, however, is 

25 Implemented by tying the LSB of these data words 02C and 03C to supply 
voltage VDD, thus "replacing" the "0" LSB of the cany word by a "1", which is 
equivalent to addition by "1". 

For the reasons provided above, a "0" is appended as the LSB to the 21- 
blt carry words from the carry-save adders CsO and CS1 (by tying the LSB to 

30 ground GND) and the LSB of the carry words from the carry-save subtracters 
CS2 and CSS is set equal to "one" by tying the corresponding data line to the 
supply voltage VDD. The resolving adders RES0-RES3, therefore, resolve the 
outputs from the adder/subtracters CS0-CS3 to form the 22-bit output signals 
OUT0[21:0]-OUT3[21:0], 
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Two advantages of the IDCT circuitry according to the embodiment of the 
present invention can be seen in FIG 14. First, no control or timing signals are 
required for the common block CBLK 232. Rather, the input signals to the 
common block are already processed in such a way they can be applied immedi- 
5 ately to the pure-logic arithmetic devise in the common block 232. Second, by 
proper scaling of the data words, integer arithmetic can be used throughout (or, 
at least, decimal point for all values will be fixed). This avoids the complexity and 
slowness of floating-point devices, w'rth no unacceptable sacrifice of precision. 
Yet another advantage of the embodiment of the present invention is that, 
10 by ordering the inputs as shown, and by using the balanced decimated method in 
accordance with the present invention, similar design structures can be used at 
several points in the silicon implementation. For example, as shown in FIG. 14, 
the constant coefficient multipliers MULCTS, MULC3S3, MULC3S2 and 
MULNC1 S ail have similar structures and receive data at the same point in the 
1 5 data path, so that all four multipliers can be working at the same time. This 
eliminates "bottlenecks" and the semiconductor implementation is, therefore, 
able to take full advantage of the duplicative, parallel structure. The carry-save 
adders BT2 and BT3 similarly will be able to work simultaneously, as will the 
following carry-save adders and subtracters. This symmetry of design and 
20 efficient simultaneous utilization of several devices is common throughout the 
structure according to the embodiment of the present invention. 

FIG 15 shows the preferred arrangement of the post-common block 
POSTC 233 in accordance with the present invention. As FIG. 1 0 shows, the 
primary functions of the post-common POSTC 233 are to form the hO to h3 
25 values by multiplying the outputs of the common block by the coefficients d1, d3, 
d5 and d7; to add the g(k) and h(k) values to form the low order outputs; and to 
subtract the h(k) values from the corresponding g(k) values to form the high- 
order outputs. Referring now to both FIG. 10 and FIG. 15, the post-common 
block POSTC 233 latches the corresponding outputs from the common block 
30 CBLK 232 into latches BHOL, BH1L, BH3L and BH2L when the Bh latches are 
enabled, the control circuitry sets the EN_BH signal high, and the output clock 
signal OUTC_ClK signal goes high. The g(k), gO to g3 values are latched into 
corresponding latches GOL, G1L, G3land G2L when the control circuitry 
enables these latches via the signal EN_GH and input clock signal IN_CLK goes 
35 high. 
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The processed odd-numbered inputs, that is, the values hO to h3, are 
latched into latches HOL, H1L, H3L and H2L when the EN_GH and IN_CLK 
signals are high, via the constant coefficient multipliers D1MUL, D3MUL, D5MUL 
and D7MUL These multipliers multiply, respectively by d1 , d3. d5 and 67. In 
5 the preferred embodiment, these constant-coefficient multipliers are preferably 
carry-save multipliers in order to simplify the design and to increase calculation 
speed. As FIG 15 aiustrates, the "cany" ("c") outputs from the constant coeffi- 
cient multipliers are connected, with certain changes described below, to the a 
inputs of resolving adders HOA. H1A, H3A and H2A. The "save" C's") outputs 
1 0 from the coefficient multipliers are similarly, with certain forced changes de- 
scribed below, connected to other input of the corresponding resolving adder. 

As FIG 15 further illustrates, the LSB of the HO signal is preferably forced 
to be a "1" by tying the corresponding "save" output for HO is set to 0 (tied to 
ground GND), and the second bit {corresponding to H0SI1]) is set to "1". The 
1 5 data words from the carry and save outputs of the constant-coefficient multiplier 
D3MUL'are similarly manipulated an input to the resolving adder H1 A. The 
advantage of these manipulations and their input to the resolving adder H1A. 

In accordance with the present invention, all 22-bits of the carry output 
from the coefficient multipliers D7MUL and D5MUL are connected directly to the 
20 "a" input of corresponding resolving adders H3A and H2A. The MSB of each 
multiplier's "save" output, however, is forced to "0" by tying the corresponding 
data line to ground GND. 

The IDCT system described was tested against the CCITT specification 
described above. Because of the scaling and other well-known properties of 
25 digital adders and multipliers, some precision Is typically lost in the 10,000 

sample, but run that forcing the various bits described above to either "0" or "1" 
reduced the expected error of the digital transformation, As a result of the bit 
manipulation of the data words, the embodiment of the present invention 
achieved acceptable accuracy under the CCITT standard using only 22-bit wide 
30 data words, whereas 24 bits would normally be required to produce equivalent 
accuracy. 

Because of limited precision, and truncation and rounding errors, there is 
typically some inaccuracy in every data word in an IDCT system. However, 
forcing selected bits of a data word it was discovered that the error thereby 
35 systematically introduced into a particular data word at a particular point in the 
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hardware yielded statistically better overall results. Bit-forcing may also be 
applied "within' a multiplication, for example, by selectively forcing one or more 
carry bits to predetermined values. 

In the present invention, the bit-forcing scheme need not be static, with 
5 certain bits always forced to take specified values, but rather a dynamic scheme 
may also be used. For example, selected bits of a data word may be forced to 
"1" or "0" depending on whether the word (or even some other data) is even or 
odd, positive or negative, or above or below a predetermined threshold, and the 
like. 

1 0 Normally, only small systematic changes will be needed to improve overall 

statistical performance. Consequently, according to this embodiment of the 
A present invention, the LSB's of selected data words (preferably one bit and one 

data word at a time, although this is not necessary) are forced to be a "1" or a 
"0". The CCITT test is run, and the CCITT statistics for the run are compiled. 

15 The bit is then forced to the other of "1" or "0", and the test is rerun. Then the 
LSB (of LSBs) of other data words are forced to "1 " or "O". and similar statistics 
are compiled. By examining the statistics for various combinations of forced bits 
in various forced words, a best statistical performance can be determined. 
If this statistically based improvement is not required, however, the 

20 outputs from the constant-coefficient multipliers D1MUL, D3MUL, D5MUL and 
D7MUL may be resolved in the conventional manner in the resolving adders 
H0A-H3A. The lower 21-bits of the input of the corresponding latches H0L-H3L, 
with the LSB of these inputs tied to ground. 

The outputs from the H-latches (H0L-H3L) and the G-latches (G0L-G3L) 

25 pairwise form the respective a and b inputs to resolving adder-subtractDrs S70A, 
S61A, S43A and S52A. As was Indicated above, these devise add their Inputs 
when the ADD signal is high, and subtract the "b" input from the "a" input when 
the subtraction enable signal SUB is high. The second bits of the upper two 
latch pairs HOI, G0L.H1L and G1L are manipulated by multiplexing arrange- 

30 ments in a manner described below. 

The outputs from the resolving adder-subtractors 570A, S61A, S43A and 
S52Aare latched into result latched R70L, R61L, R43L, R52L. 

As depicted in FIG 15b, the input words to the adder/subtractor S70A and 
dS61 A, in accordance with the present invention, have the second bits of each 

35 Input word manipulated. For example, the second bit of the input word to the "a"- 
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input of the adder subtracter S7QA is G0[1M], G0I1M1. G0[0]. In other words, the 
second bit is set to have the value G01M. The second bits of the other inputs to 
the adder/subtracters S70A and S61A are similarly manipulated. This bit 
manipulation is accomplished byfour2:l-bit multiplexers H01MUX, G01MUX, 

5 H11 MUX and G11MUX (shown to the right in FIG 15b). In the present invention, 
these multiplexers are controlled by the ADD and SUB signals such that the 
second bit (H01M, G01M, H11M, and G11M) Is setto one If the respective 
adder subtracter S70A, S61A Is set to (ADD is high), and the second bit is set to 
Hs ectua! latch output value if the SU B signal is sat too high. Setting of individual 

10 bits in this manner is an easily implemented high-speed operation. The preferred 
embodiment, therefore, includes this bit-forcing arrangement since, as is 
described above, statistical analysis of a large number of tests pixel words has 
indicated that mora accurate results are thereby obtained. It is not necessary, 
however, to manipulate the second bits in this manner, although it gives the 

15 advantage of smaller word width. 

The four high or low-order results are latched in the output latches R70L, 
R61 L, R43L and R52L. The results are sequentially latched into the final output 
latched OUTF under the control of the multiplexing signals MUX_OUT70. 
MUX_OUT61, MUX_OUT43, MUX_OUT52. Hence, the order in which resulting 

20 signals are output can therefore be controlled simply by changing the sequence 
with which they are latched into the latch. 

The relationship between the clock and control signals in the post-com- 
mon block POSTC 233 Is shown In FIGS. 13b and 13c. 

As was discussed previously, two 1-dimensional IDCT operations may be 

25 performed in series, with an intervening transposition of data, in order to perform 
a 2-D IDCT. The output signals from the post-common block POSTC 233, are 
therefore, according to this embodiment of the present invention, first sorted in a 
known manner column-wise (or row wise) in a conventional storage unit, such as 
a RAM memory circuit (not shown), and are then read from the storage unit row- 

30 wise (column-wise) so as Id be passed as inputs to a subsequent pre-commDn 
block and for processing as described above in this block, and in a common 
block CBLK 232, and a post-common block POSTC 233. 

Storing by row (column) and reading out by column (row) performs the 
required operation of transposing the data before the second 1-D IDCT. The 

35 output from the second POSTC 233 will be the desire, 2-D IDCT results and can 



(282) 



WF8- 1 7 2 6 2 4 



67 

be scaled in a conventional manner by shifting to offset the sealing shifts carried 
out In the various processing blocks. In particular, a right shift by one position 
will perform the division by 2 necessary to offset the two square root of two 
multipDcations performed In the 1-D IDCT operations. 

5 Depending on 1he appfications, this second IDCT structure (which is 

preferably identical to that shown FIG 1 1) is preferably a separate semiconductor 
implementation. "This avoids the decrease in speed that would arise If the same 
circuits were used for both transforms, although separate 1-D transform imple- 
mentations are not necessary if the pixel-clock rate is now sufficient such that a 

10 single implementation of tne circuit will be able to handle two passes In real time. 
As shown in FIGS 16 through 38, a second preferred embodiment, in 
accordance with the present invention, uses a single one-dimensional transform. 
This embodiment does not require a lowering of the pixel-clock rate as discussed 
previously. 

15 The easting "resolving-adders" in the first preferred embodiment have 

been changed to "fast-resolvng-adders". As seen in FIG 38, these have been 
titled, "Fast Resolving Adders". This change has the effect of allowing more time 
for each datapath arithmetic block to act on its data Inputs. The existing 
"latches" in the first preferred embodiment have been changed to 2-phase "fiip- 

20 flops" or "registers". 

The latching memory elements located on the front and end of the existing 
1D IDCT datapath pipelines have been combined into single blocks, as shown 
particularly In particular in FIG 18. Additionally, the amount of memory elements 
present at the input and the output of the second preferred embodiment has 

25 been increased to allow variable amounts of T2 data ta be buffered. 

As shown In FIGS. 16 and 17, the two data streams, stream "T1" (raw 
unoperaled upon data) and stream T2" (data which has been through the ID 
IDCT once and has been transposed in the TRAM), are introduced into the 
datapath pipeline In a time multiplexed fashion. 

30 In the present invention, each stream takes its turn to introduce a group of 

data items into the datapath pipeline. The dala streams are "interleaved" as they 
pass sequentially down the datapath pipeline and are "de-interleaved" at the 
datapath output, as shown in FIGs. 17, 18 and 33. A group can vary in number, 
but in this example, they are eight bits. 
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In accordance with the present invention, T1 must not be stalled. If T2 
arrives at the point of interleaving with T1, but the input buffer should not intro- 
duce its data into the pipeline because this would clash with the T1 stream, then 
stream T2 provides an extra buffering so that T2 does not stall the data stream, 
5 but instead will buffer up data from Ms input stream until such a time as it may 
safely Interleave with stream T1. This is shown in FIGs. 19 and 33 where the 
data from stream T1 is being loaded into the first transform in latches 0-7, using 
signals. "Latch 1(0) through' Latch 1(7)". Additionally, data from T2 is being 
loaded in "Latch 2(0) through' Latch 2(1 5)", as shown in FIG. 19, using signals 

10 shown in FiG. 33. 

The interleaving is controlled by T1 OK2 insert" and 'T2 OK2 insert" 
signals. Under normal operation, the interleaving will occur when the signals go 
high. However, "rf the appropriate amount of data in the latch forT2 has not yet 
been reached when 'T2 OK insert" goes high, then the latch will miss its opportu- 

1 5 nity and must continue buffering data until the next opportunity to insert data 
occurs.'* 

in summary, if the above described buffering, in accordance with the 
present invention, is to occur, comparable "slippage" has to occur at the output 
of T2. T2 slips when it misses its data insertion point and has to continue 

20 buffering in the letches shown in FIG. 1 9. If T2 slipped and did not introduce 

data into the pipeline there will be a corresponding gap in the T2 stream output at 
the datapath output. This gap may be removed or "swallowed up" by use of the 
extra buffering at the T2 output. This process may be thought ol as having a 
"•fixed" T1 - 1D IDCT transform with a variable T2 - 1 D IDCT, where the data 

25 streams are Interleaved In a time multiplex fashion such thai they may use the 
same piece of arithmetic datapath pipeline. 

In the present invention, "Recovery" takes place when non-data enters T1. 
It is an opportunity for the T2 buffer to catch up to T1 and the datastream. Non- 
data is a data type that bypasses the IDCT and is shown as a data spike in 

30 "Latch 2 [ $ ]" of FIG. 34. This eventually makes its way to T2 input, which 

allows the T2 buffering to fill up at the output. Recovery is shown in FIG. 33 and 
FIG. 25 when the "T2 dout" signal and the "out" signal are gapped by a number 
of cycles. The gap is used as a reference to fix the data stream. It should be 
noted that the gap in cycles between these two signals is the same as the gap of 

35 buffering when the latch for T2 was waiting to insert its data. 
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Following the TRANSFORM in POSTC 233 part B, the interleaved stream 
is de-interleaved into T2 out", as shown in FIGs. IB and 23. The 'T2 out" data 
stream has slip gaps in the data as described above. The T2 out [143: <(>), 
shown in FIG. 17, enters a 16 to 1 multiplexor block, shown as block "IDDPMUX" 
5 in FIG. 17. This multiplexor block will select data from one of 1 6 positions in the 
output buffer block, as shown in FIG. 25. This position is selected by the control 
logic, shown in FIG. 29, which uses the gap by which T2 "buffered-up" at its 
input This gap is used as a reference. The output stream, T2DOUT, from the 
multiplexer block is the "fixed" data stream. 

10 In range tests carried out on an embodiment of the present invention for 

the IDCT arrangement described above, H was found that all intermediate and 
final values were kept well within a known range at each point while stiil meeting 
the CCITT standards. Because of this, it was possible to "adjust" selected values 
as described above by small amounts (for example, by forcing certain bits of 

15 selected data words to desired values) without any fear of overflow or underflow 
in the arithmetic calculations. 

The method and system, in accordance with the present Invention, can 
be varied in numerous ways. For example, the structures used to resolve 
additions or multiplications may be altered using any known technology. Thus, it 

20 is possible to use resolving adders of subtracters where the preferred embodi- 
ment uses carry-save devices with separate resolving adders. Also, the pre- 
ferred embodiment of the present invention uses down-scaling at various points 
to ensure that all values remain within their acceptable ranges. Down-scaling Is 
not necessary, however, because other precautions may be taken to avoid 

25 overflow or underflow. 

In one embodiment of the present Invention, certain bits of various data 
words were manipulated to reduce the required word width within the system. 
However, the various intermediate values may, of course, be passed without bit 
manipulation. Furthermore, although only data words were bit-manipulated in 

30 the illustrated example of the present invention, ft is also possible to manipulate 
the bits of constant coefficients as well and evaluate the results under the CCITT 
standard. If a comparison of the results showed that it would be advantageous 
to force a particular bit to a given value, in some cases, on might then be able to 
increase the number of "zeros" in the binary representation of these coefficients 
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in order to decrease further the silicon area required to implement the corre- 
sponding multiplier. Once again, bit manipulation is not necessary. 

In summary of the above aspects of the present invention, the following is 
disclosed: an apparatus for transforming data having a first latch defining a first 
5 data stream source and a second latch defining a second data stream source. 
The first and second latches are in communication with a single arithmetic unit. 
The arithmetic unit communicates data to a transpose RAM. the transpose RAM 
transposes the data and communicates it to the second latch. The second iatch 
is adjustable and can be varied in size to accommodate variable rates of data 

1 0 being received and transmitted, The second latch and first latch communicate 
1st and 2nd data stream to the arithmetic unit sequentially, however, the sequen- 
tial communication of the second latch does not interrupt the communication 
from the first latch. In this manner, common arithmetic unit is used for a first and 
second data stream. Furthermore, a process for transforming data using a 

1 5 common arithmetic unit having the following steps is described. First, loading the 
data into a first latch and, upon reaching a predefined number of cycles transmit- 
ting the data to an arithmetic unit and loading a first marker bit into a control shift 
register. Next, loading data into a second lalch, the second latch is adjustable 
and can be varied in size to accommodate variable rate of data being received 

20 and transmitted at different rates. The next step is to transmit the data in the 
second iatch to the arithmetic unit when the first control shift register reaches a 
predetermined state and the second iatch is filled with a predetermined amount 
of dala. Next, preventing transmission of data from the second latch, if the 
second latch Is not filled with a predetermined amount of data and then recover- 

25 ing the second latch when the first latch is receiving non data. 
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Detailed Description of Invention for Time Synchronization 
In MPEG-2, video and audio data is synchronized using information 
carried in the MPEG-2 systems stream, in this regard, there are essentially two 
types of information that deal with synchronization; clock references and time 
5 stamps. Clock references are used to inform the decoder what number is used 
to represent the time "now". This is used to initialize a counter that is incre- 
mented at regular Intervals so that the decoder always knows what the current 
time is. 

TimB stamps are carried in some of the streams of data that are used to 
10 make up the programme (typically video and audio). In the case of video, a time 
stamp is associated with a picture and tells the decoder at what "time" (defined 
0 by the cou nter that was initialized by the clock reference) a picture should be 

displayed. 

In MPEG, multiplexed into the system stream are a series of clock refer- 
15 ences. These dock references define the "system time". There are two types of 
clock reference; Program Clock References (PCRs) and System Clock Refer- 
ences (SCRs). In the present invention, the distinction between PCRs and SCRs 
is not relevant since each of the clock references are used in the same manner 
by the decoder. PCRs and SCRs have timing information to a resolution of 90 
20 kHz with a further field extending the resolution to 27 MHz (or 1/27 X 10e6 in 
seconds). Clock references are included in the data stream fairly often in order 
that "system time" may be reinitialized after a random access or channel change. 
Accordingly, it Is Important to appreciate that timestamps refer to a hypothetical 
^ model of a decoder that can decode pictures instantly. As will be appreciated by 

^ 25 one of ordinary skill in the art, any real decoder cannot do this and must take 
steps to modify the theoretical time in which pictures should be displayed. 
Furthermore, time stamps and the clock references are used to determine 
display time and errors in display time. This modification depends upon the 
details of the architecture of the particular decoder. Clearly any delay introduced 
30 by the video decoder must be matched by an equivalent delay in the audio 
decoder. 

When decoding MPEG, discontinuities in the concept of "system time" 
may occur. For instance in an edited bitstream, each edit point will have discon- 
tinuous time. A similar situation occurs at channel change. It will be appreciated 
35 that care must be taken when using time-stamps, because using a time stamp 
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lhat was encoded in one time regime with respect to a "system time" defined by a 
clock reference from another regime will clearly lead to incorrect results. 

Figure 39 shows the demultiplexing of the MPEG systems stream into 
elementary streams 250. Each elementary stream will typically carries either 
5 video or audio data although, in general, any form of data may be transported. 
Each elementary stream Is divided Into a series of access units. In the case of 
video, the access unit Is a picture. In the case of audio, It Is a fixed number of 
samples of audio data. 

Also multiplexed into the systems stream are a series of clock references. 
1 0 These dock references define the "system time". 

In accordance with the present invention, associated with each elemen- 
tary stream is a series of time stamps 251. The time stamps specify the "system 
time" at which the next access unit for the respective elementary stream is to be 
presented. These time stamps are referred to as presentation fr'me stamps, 
15 "PTS". 

In the case of video data, a second type of time stamp is also defined is 
referred to as a decode time stamp, "DTS". Since the DTS is only present when 
a PTS is also present and there is a simple relationship between them, the 
detailed differences between these two types of timestamps can be ignored 

20 since PTS/DTS differences have no bearing on the present invention. 

The decode time stamps (DTS) define the time at which an access unit 
(picture in the case of video) is to be decoded. The presentation time stamps 
(PTS) define the time at which an access unit is to be presented (displayed). 
However, the timing model used is a hypothetical model in which the decoder is 

25 infinitely fast. In this case, the DTS and PTS would be identical to one another. 

However, in MPEG video decoding, some of the pictures are reordered. 
Therefore, after decoding, the pictures are held in storage for a time period, e.g., 
several frame times, before they are displayed. During this time period, other 
pictures that are decoded subsequent to the picture in question are displayed. 

30 Consequently, for these reordered pictures there is a difference between the 
DTS and PTS. 

In accordance with the present invention, it will be appreciated that to 
properly synchronize time, it is necessary to be consistent in the use of time 
stamps. In one preferred embodiment, the time synchronizing circuitry is placed 
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at a point in the decoding pBpBline when the pictures occur in their decoded 
order. Accordingly, this embodiment uses the DTS. 

Nevertheless, the circuitry could equally be moved to a point in 1he 
decoding pipeline that occurs after the pictures are reordered and, therefore, the 
5 .pictures would reach the synchronizing circuitry in their display order. Hence, as 
will he appreciated by one of ordinary skill in the art, PTS would be used in this 
embodiment. 

In the preferred embodiments of the present invention, the information . 
derived from the timestamps is transported through the various circuits by means 

10 of tokens. Tokens consist of a series of one or more words of information. The 
first word of the token contains a code which identifies the type of token and. 
hence, the type of information carried by that token. Associated with each word 
of the token is an extension bit which is set to one to indicate that there are more 
words in the current token. Therefore, the last word of a token is indicated by 

15 the extension bit being zero. In the present invention, the code in the first word 
indicating the type of token may be of a variable number of bits so lhat some 
codes use a small number of bits (allowing the remainder of the bits in the first 
word to be used to represent other information) while other codes use a larger 
number of bits. 

20 Tokens may be characterized as being either control or DATA tokens. For 

example, at the Interlace between the system decoder and the video decoder, 
there are two types of information: (1) the coded video data and (2) the synchro- 
nization time derived from the time stamp information. The coded video data is . 
viewed as data and Is carried in a DATA token (e.g., the token called DATA) 

25 while the synchronization time is viewed as conlrol information and is carried in a 
control token (called SYNC_TIME). Additional control tokens may also be used 
from time to time in the present invention. For example, 9 FLUSH token that 
behaves in a manner similar to a reset signal may be required to initialize Ihe 
video decoding circuitry before attempting to restart decoding because of an 

30 error. 

In accordance with the present invention, it is an object of one preferred 
embodiment to time synchronize two circuits and, more particularly, to time 
synchronize two circuits without directly communicating system time from the first 
to the second circuit. In accordance with the invention, time synchronization of 
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two circuits is accomplished without passing system time directly to the second 
circuit by providing synchronized time counters in each circuit 

The present invention also enables the system to time synchronize two 
circuits without communicating system time from the first to the second circuit by 
5 providing an elementary stream time counter in each circuit. 

Accordingly, another object of Ihe present invention is to time synchronize 
two circuits and to determine the presentation time error, if any, of the object 
being presented by using time stamp information, system time, and elementary 
stream time from the first circuit to generate synchronization time passed to the 
10 second circuit and compared to a copy of elementary stream time in the second 
circuit which is synchronized with the elementary stream time in the first circuit, 
The system of the present invention can time synchronize a system decoder and 
a video decoder without directly communicating system time from the system 
decoder to the video decoder, without passing system time directly to the video 
15 decoder by providing synchronized time counters in each circuit and without 
communicating system time from the system decoder to the video decoder by 
providing a video counter in each circuit. 

The invention also enables the system to time synchronize a system 
decoder and a video decoder and to determine the display time error, if any. of 
20 the picture being displayed by using video time stamp information, system time, 
and video decoding time from the system decoder to generate synchronization 
time which is then passed to the video decoder and compared to a copy of video 
decoding time in the video decoder which is synchronized with the video decod- 
ing time in the system decoder. 
25 In accordance with the present invention, Information derived from the 

timestamps can be transported through the system using a control token as 
previously described. 

Figure 40 shows a first preferred embodiment implementing elementary 
stream timestamp management, in accordance with the present invention. The 
30 clock references 253, which represent system time, are decoded by the system 
demultiplexer 254 and placed initially, and then as needed, into a time counter 
255 within the system decoder 256, and are incremented at 90 kHz. A second 
copy of the clock reference 253 is simultaneously loaded into the time counter 
255 that is Inside the elementary stream decoder 257, incremented also at 90 
35 kHz, and synchronized to the time counter 255 in the system decoder 256. 
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The time stamps 251, in aw^ance with the present invention, flowfrom 
the system demux 254 through the elementary stream buffer 260 so that they are 
delayed by the same amount as the incoming data. The time stamps 251 may 
also have a correction added to compensate tor the non-zero decode time of the 
5 elementary stream decoder 257. The corrected time stamps 26 1 are then 
compared with the copy of the time stored the time counter 258 inside the 
elementary stream decoder 257 to determine whether the decoded information is 
presented too early or too late. 

The above embodiment is better than merely passing system time directly 

10 to the elementary stream decoder 257 from the time counter255 in the system 
decoder 256 because the counter in the system decoder changes BO.OOO times a 
second. Therefore, system lime would, in all essence, need to be continually 
passed to the elementary stream decoder 257. Passing system time continually 
would require dedicated pins or the like. By using a time counter 255 located in 

15 the system decoder 255 and a time counter 255 located in the elementary 

stream "decoder 252, system time can be passed in the form of clock references 
253 a few times a second. 

Another embodiment is shown in Figure 41. The embodiment shown in 
Figure 41 avoids the need for the clock references 253 to be passed to the 

20 elementary stream decoder 257. This is achieved by using a second counter" 
esjime" 262, containing information on elementary stream time, which is 
maintained in both the system decoder 256and the elementary stream decoder 
257. The two esjime counters 262 and 253 ere reset at power on, and at other 
times such as channel change, and then they free run from there on. Since this 

25 embodiment depends on the two esjime counters 2S2 and 263 staying in step, 
it will be appreciated that it is necessary to take measures to ensure the es_time 
counters do not get out of step. One way 1o ensure the es_tirne counters 262 
and 263 stay in step is to use carry out of the es_time counter in the system 
decoder to reset the es_time counter in the elementary stream decoder 257 as 

30 shown in Figure 41. 

As further shown in Figure 41, the clock references 253. which represent 
system time, are decoded by the system demultiplexer 254 and placed into a 
time counter 255 within the system decoder 256 and incremented at 9D kHz.. 
The esjime counter 262 in the system decoder 256 of the present invention and 

35 the esjime counter 263 in the elementary stream decoder 257 of the present 
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Invention are synchronized with each other and incremented at 90 kH2. Elemen- 
tary stream time stamps are also decoded by the system demultiplexer 254. 
Accordingly, a synchronization value X is computed using the elementaiy stream 
fjmestamp, the system time contained in the time counter and the elementary 

5 stream time contained in the esjime counter 262 contained in the system 
decoder 256 according to the equations 3-1. 

The following set of equations 3-1 (a - d) is illustrative of one method in 
accordance w'rth the present invention, for time synchronization which avoids 
passing the clock references 253 to the elementary stream decoder 257. 

10 Equation 3-1 (a) is the equation required for time synchronization. Since it is 

undesirable to pass system time directly to the elementary stream decoder circuit 
257, as shown in Figure 41, a synchronization time representation X is gener- 
ated, using Equation 3-1 (b-d). by the system decoder 256 and this value is 
passed to the elementary stream decoder. Synchronization time X Is then 

15 compared to the elementary stream time contained within the esjime counter 
263 located within the elementary stream decoder 257. Hence, the compared 
result is used lo determine whether the decoded information is presented too 
early or too late and then is further used in time synchronizing the system. 
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Equations 3-1 : 

a) Time Synchronization = (Elementary stream timestamp - system time) 

b) Time Synchronization = (X - elementary stream time) 

c ) (X- elementary stream time) = (elementary stream timestamp -system 
5 time) 

d) X " (elementary stream timestamp - system time + elementary stream 
time) 

In the present invention, the synchronization time. X. may have a correction 
added to compensate for the non-zero decode time of the elementary stream 
10 decoder 2S7. The corrected synchronization time is then compared with the 
elementary stream time contained in the esjime counter 263 located inside the 
elementary stream decoder 257 to determine whether the decoded information is 
presented too early or too late and is further used to time synchronize the 
system. Note, the time correction could be subtracted from elementary stream 
15 time contained in the esjime counter 263 located inside the elementary stream 
decoder 257 instead of added to synchronization time X for the same result. The 
above embodiment is an example of a solution for generating synchronization 
time X and determining whether the information is presented early or late. It will 
be apparent 1o those skilled in the art that there are many other equivalent 
20 solutions for accomplishing the above. 

For example, Figure 42 shows an alternative method for determining the 
synchronization time, X, in accordance with the present invention. In this 
arrangement, the system decoder 256 does not maintain an elementary 3tream 
time. Instead it records, in the register initial Jme 265, the value of system time 
25 at the instant that the elementary stream time counter, esjime 263, located In 
the elementary stream decoder 257 is reset to zero. The value in esjime 263 
can be computed by the system decoder 256 because it will be the difference 
between the current system tkne and the value recorded in initialjime. 
The following equations 3-2 (a-c) is illustrative of this alternative method for 
30 time synchronization. Equation 3-2 (a) is the equation representing the value of 
the elementary stream time stored in esjime 263 located in the elementary 
stream decoder 257. This is substituted into equation 3-1 (d) to give equation 3- 
2 (b) which is simplified to derive equation 3-2 (c) providing thB synchronization 
time, X, as a function of the system time and the value stored In the Initialjime 
35 register 265. 
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Equations 3-2: 

a) elementary stream time = system time - initialjime 

b) X = (elementary stream timestamp - system time + [system time - 
initial Jiroe]) 

5 c) X » (elementary stream timestamp ■ initialjime) 

Two solutions for deriving the synchronization time, X, in accordance with 
the present invention have been illustrated. However, it will be apparent to those 
skilled in the art that there are many other equivalent solutions. 

Figure 43 shows another embodiment of the present invention implement- 

10 lng video timestamp management. The clock references 253, which represent 
system time, are decoded by the system demultiplexer 254 and placed Initially, 
and then as needed, into a time counter 255 within the system decoder 256 and 
are incremented at 90 kHz. A second copy of the clock references 253 are 
simultaneously loaded into the time counter 258 that is inside the video decoder 

1 5 270 and incremented at 90 kHz, and synchronized to the time counter 255 in the 
system'decoder 256. 

The video time stamps flow from the system demux 254 through the video 
decoding buffer 271 so that they are delayed by the same amount as the 
incoming video data, The video time stamps may have a correction added to 

20 compensate for the non-zero decode time of the video decoder 270. The 

corrected video time stamps are than compared with the copy of the time in the 
time counter 258 Inside the video decoder 270 to determine whether the de- 
coded picture is displayed too early or too late. 

The embodiment shown in Figure 43 is an improvement over the process 

25 of merely passing system time directly to the video decoder from the time counter 
in the system decoder because the counter in the system decoder changes 
90,000 times a second. Therefore, system time would in all essence need to be 
continually passed to the video decoder. Passing system time continually would 
require dedicated pins or the like. By using a time counter located in the system 

30 decoder and a time counter located in the video decoder system time can be 
passed in the form of clock references a few times a second. 

Referring now to Figure 44, the clock references, which represent system 
time, are decoded by the system demultiplexer 254 and placed into a time 
counter 255 within the system decoder 256 and incremented at 90 kHz. The 

35 vidjime counter 272 In the system decoder 256 and the vidjime counter 273 in 
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the video decoder 270 are synchronized with each c-ther and Incremented at 80 
kHz. Video time stamps are also decoded by the system demultiplexer 264. 
Accordingly, a synchronization value X is computed using a video timestamp, the 
system time contained in the time counter 273 and the video decoding time 
5 contained in the vld_time counter 272 contained in the system decoder 256 
according to the equations 3-2 

The following set of equations 3-3 (a - d) is illustrative of one method in 
accordance with the present invention, for time synchronization which avoids 
passing the clock reference 253 to the video decoder 270. Equation 3-3(a) is the 

10 equation required for time synchronization. Since it is undesirable to pass 
system time directly to the video decoder circuit 270 as shown in Figure 44. a 
synchronization time representation X is generated, using Equation 3-3 (b - d). 
by the system decoder 256 and passed to the video decoder 270. Synchroniza- 
tion time, X, is then compared to the video decoding time contained within the 

15 vid_time counter 273 located within the video decoder 270. The compared result 
is used'to determine whether the decoded picture is displayed too early or too 
late and then further used in time synchronizing the system. 
Equations 3-3: 

a) Time Synchronization = (Video timestamp - system time) 
20 b) Time Synchronization = (X - video decoding time) 

c) (X - video decoding time) = (video timestamp - system time) 

d) X = (video limestarnp - system time + video decoding time) 

In the present invention, the synchronization time, X, may have a correc- 
tion added to compensate for the non-zero decode time of the video decoder. 

25 The corrected synchronization time is then compared with the video decoding 

time contained in the vidjime counter 273 located inside the video decoder 27D 
to determine whether the decoded picture is displayed too early or too late and is 
also used to time synchronize the system. Note, the time correction can be 
subtracted from the video decoding time contained in the vid_time counter 273 

30 located inside the video decoder 270 instead of added to synchronization time X 
for the same result. The above embodiment of the present invention is another 
example of a solution for geneiating synchronization time X and determining 
whether the picture is displayed early or late. However, it will be apparent to 
those skilled in the art that there are many other equivalent solutions for accom- 

35 piishing the above. 
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Another nice feature, in accordance with the present invention, is that 
there is no need to deal with the full 33 bit time stamp number or 42 bit clock 
reference number. The present invention restricts the counters to 16 bits to allow 
16 bit handling on the video decoder 270. At first glance, it would appear that 16 

5 bits cannot represent a sufficient number range at a resolution of 90 kHz (only 
213 second to be used). However, there is no need tor such high precision 
because the time control on the video decoder 270 is only accurate to a field time 
(since the video timing generator VTG ftee-runs or is gen-locked to something 
that has nothing to do with the MPEG stream being decoded) and, therefore, it is 

10 not related to tlmestamps or presentation time in any way. 

As shown in Figure 44 and Figure 45, the synchronization time X and the 
vidjime counter 273 within the video decoder 270 use only sixteen bits. This is 
made possible by two factors. First, the difference between system time and 1he 
timestamp (used to derive the synchronization time; see Equation 3-3) should 

1 5 always be small, thus allowing the more significant bits to be discarded. Second, 
it is only possible to control the presentation of video to the nearest framefime. 
Therefore, the less significant bits are not required and are discarded by shifting 
right by four bits. 

Thus, the sixteen bits of time information used in the present invention are 
20 able to deal with timing errors of up to about 1 1 .5 seconds with an accuracy of 
about 180 *iS (about 1% of a field time). A PAL or SEC AM European 625 line TV 
system is, thus. 1 12.5 ticks of the 5625 Hz ciock; a NTSC 525 line TV system is 
93.84 ticks. Hence, using 16 bits allows timing calculations with an accuracy of 
about 1% of a field time. 
25 Figure 46 shows the preferred process, in accordance with the present 

invention, of Ihe moving the time stamp through the hardware. The preferred 
method for communicating information in this hardware is Tokens, but it will be 
appreciated that alternative methods may also be employed. The hardware is 
divided into two modules. The first module is added just after the Start Code 
30 Detector 201 . This module is responsible for generating a token, SYNC_TIMc 
containing the synchronization time X, as discussed above, and this occurs just 
before an associated PICTURE_START token. In the MPEG systems stream, 
the time stamp is carried in a packet header and refers to the first picture in the 
packet of data. Since the packets do not line up with the video data, there will, in 



(296) 



1#H¥8- 1 7 2 6 2 4 



general, be the end of the previous picture before the start of the picture to which 
the time stamp refers. 

The synchronization time information may be supplied to the present 
invention either via a microprocessor interface or by using a Token. In either 
case, the synchronization time date (16 bits) is stored in the synchronization time 
register (divided into two parts to allow access to each byte individually), es 
further detailed in Table 12. 



Register 



Slze/DI Reset 



Description 



i eight bils of the synchronization 



Ctha; win become part of a SYNC_TIHE to 



Writes lots Jow register at! 



Tne upper eight Ms of the synchronization 
time value. 

Slaved in the same way as tsjow. 
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Register 


Slze/Di 


Reset 


Description 


ts_val!d 


Urw 


0 


ttjow and tsjilgh. 

When values have been written into 
tsjDW and tejiigh the microprocessor 
should write the value one Into this bit H 
should then poll the bit unit It leads back the 
value one. At this point the values written Into 
ttjow and tsjilgh will have been transferred 
into the slave registers [and can be read back) 
and ts_waiting will be set to one. 

The microprocessor should then write 
the value zero In preparation for the next ac- 


ts-waiting 


Vto 


0 


When sel to zero the registers Isjow and 
1s_hioh do nol contain valid synehroniretion 
lime information. 

When set to one the registers tsjow 
and ls_hioh contain valid synchronization time 
informstion. A SYNC_TIME 1oten will be oen- 
Biated before the next P)CTURE_START to- 
ken and ls_wailing will then become zero. 

This bit should be poied Id ensure 

to ensure 1hat the previous synchronization 
time Yslue hB5 been used before il is overwrit- 
ten by the masicr-lo-slave transfer. 



Table 12 Microprocessor registers for handling synchronization time 



In the present invention, a flag, ts_waiftig, is sel to indicate 1he fact that valid 
synchronization time information is in the timestamp register, if the data was 
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supplied using the SYNC_TIME token, then that ioken is removed from the 
stream of tokens. 

When a P!CTURE_START token is encountered, the flag that indicates 
the status of the synchronization time register is examined. If the flag is not set, 
5 then no action is taken and the PICTURE_START token and all subsequent data 
Is unaffected. If, however, the flag is set, indicating that valid synchronization 
time information is available in the register, then a SYNC_TIME token is gener- 
ated and placed in the data stream before the PICTURE _START taken. The 
flag is then cleared and the synchronization time register is made available for 
1 0 the next time-stamp that occurs. 

The second module as shown in Figure 46, consists of a prescaler 
£ clocked at 27 MHz and a vkJJime counter clocked by the prescaler 27B which 

are associated with the microprogrammable state machine, (MSM) 216. 
There is a prescaler 278 that divides the clock by 4BDD, as shown in 
15 Figure 44 and Figure 46. In other words, 4600 is 300 (27 MHz / 90 kHz) times 
16. The 4804.8 option shown in Figure 45 and Figure 46 is discussed below. 

In the NTSC color television, the frame rate is not 30 Hz but is, in fact, 
approximately 29.94 Hz (precisely 30000/1 DD1 Hz). [Before the advent of color 
television 30 Hz precisely was used.] There are precisely -1716, 27 MHz clock 
20 periods per NTSC line time (line time is 1/525 of frame time). 

The American television standards body has expressed an interest in 
returning to 30 Hz in the future (or more probably 60 Hz for HDTV). As a result 
MPEG supports a frame rate of 30 Hz precisely. However, since it is not posei- 
a ble to generate a stable 30 Hz television signal from a 27 MHz clock (there being 

25 171 4.29...cycles per line) h is difficult to generate a 30 Hz raster in the MPEG 
framework. 

One possible solution is to "bend" the clock rate at the decoder so that 
instead of producing a 27 MHz clock, a 27.027 MHz clock is generated. This 
clock is generated using the MPEG clock references with a divider of 300.3 
30 (rather than 300) to yield the 90 kHz clock. This 27.027 MHz clock when clock- 
ing the identical video timing circuitry that provides a 29.94 Hz frame rate from 27 
MHz will give a precise 30 Hz rate. 

In the framework of the present invention, the 90 kHz is prescaled by a 
further factor of 16. Accordingly, division of the 27.D27 MHz clock by 
35 300.3x16=4804.8. 
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The Vid_time counter 273 (discussed above) contains the video decoding 
time and is incremented each time thai the piescaler reaches its terminal count 
The vid_time counter 273 is reset by the reset-time pin. 

The prescaler and vid_time counter of the present riventic-n can be 
5 implemented with fully clocked feed-back flip-flops which are much more resis- 
tant to cr-partiele corruption than the resistive-feedback or weak-feedback 
latches used elsewhere. Using clocked feedback flip-flops for time counters will 
help ensure that the time counter in the video decoder stays in step with the time 
counter in the system decoder. 

10 Figure 47 illustrates the process the MSM 218 performs when it receives 

the SYNCJTIME token. The MSM 218 is able to read the current time indicated 
by the video time counter and to then compare it with the value supplied by the 
video SYNC_TIME token. It can, therefore, determine whether it Is early or late, 
as compared to the time at which it should be decoding the pictures. 

15 In the present invention, a 16 bit signed timestamp correction is added to 

the synchronization time X (discussed above) that was carried by the video 
SYNCJTIME taken. This correction is reset to zero by the MSM 21 8 at chip- 
reset, and if no action is taken, the synchronization time remains be unaltered. 
The controlling microprocessor can always write value into ts_correction to 

20 modify the synchronization time and, therefore, compensate for differential 
delays through the video and audio decoders. 

The current video decoding time contained in the vid_time counter 273 is 
subtracted from the corrected synchronization time. The sign of value gives the 
direction of the error (and determines the error code, rf any, generated by the 

25 MSM 21 8 ). The absolute value of the difference is then taken and the result is 
compared to a threshold value to determine whether the timing error is within 
acceptable limits. Since, at present, the video timing can only be controlled to an 
accuracy of plus or minus a frame time from the nominal time (because the VTG 
333 free-runs) this threshold is set at one frame time. 

30 If the error exceeds a frame-time, then some correclion must be made. 

The MSM 218 of the present invention can conect the situation itself if the 
decoding is too early since the MSM can simply delay the decoding until the 
appropriate time. However, if the decoding is later than the intended time, then 
time correction is more difficult because it is not possible to discard pictures 

35 ■ reliably at the output of the coded data buffer. Essentially, the decoding of the 
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sequence is broken and the most reliable way to cored the situation is to restart 

the decodina process in a manner similar to random-access or channel change. 

in order to facilitate this process, the control register of the MSM 21 B may be 

programmed to discard all data until a suitable start code or FLUSH token is 
5 encountered. In addition, the error "ERR_TOO_EARLY" is not generated durina 

start-up. Irrespective of the setting of disable_too_eariy, because at start up, the 

first picture is expected to be early. 

Table 1 3 is illustrative of how the MSM 218 registers work and details 

some of the actions and error messages information placed in the registers can 
10 generate. 



• 



Register Name 


Size/Dir 


Reset State 


Description 


ts_ccrr*ction 


16/rw 


zero 


Correction added to synchronisa- 
tion time before it is used. 


frim«_ttme - 


16Jrw 


226 or 186 


Represents the tolerance on the 
Siring of decoding pictures. Reset 
state determined by the PAUNTSC 


1 xid_time 


"l6frO 




Reset by either reset or 
reseMime. The current value of 
video decoding time. 


manual_startup 


Urn 




When set to one the start-up is to 
be performed manually using 
decode_dlsable. In this case 
3EQUENCE_END and FLUSH 
tokens Bt the MSM cause 
decode disable to be set to one. 
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Agister Name 


SUe/Dir 


Reset Stats 


Description 




ieeode_disable 


1/r* 


tero 1 


When set to zero the decoding 
proceeds normally. 

At the start of each pic- 
ture the MSM checks the status of 
rfeeode_disable and will no! pro- 
ceed ITIt is set to one. 

Note that ff manual start- 
up is to be performed (Le. without 
the flme-stemp management 
hardware) then this bit should be 


• 








set to one at the same time as 
manual_startup is set to one. 




dtsable_too,eariy 


1/rw 


zero 


When set to one the error 

"ERR_TOO_EARLY" Indi- 
cating that the decoding is loo early 
is suppressed and the MSM simply 
waits to correct the situation. 




NTSC_30 


1/rw 


zero 


When set to one the presceler di- 
vides by 4604.B rather than 4800. 
Set automatically when decoding 
30 Hz frame rates. 


• 


diseardjfjate 




zero 


This has no effect unless an 
"ERR_TOO_LATE" is generated 
(or would be generated if errors 
were not masked out). If it is set to 
one then data is discarded until the 
condition indicated by 
dlscard_until. 
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Register 
name 


Size/Di 
r 


Reset State 


Description 


dlscard_until 


2/rw 


zero 


Indicate the condition which causes 








time-stamp triggered discarding to be 








terminated. 

0 - FLUSH 








1 - SEQUENCE_START 








2 - GRDUP_START 








3 -NEXT PICTURE 








Note 1 - that discarding one 








picture may immediately be un-done 








it that picture Is a field picture by the 








generation of a dummy field to pre- 








serve the alternating topfoottom held 








structure. As a result If d)scard_until 








is set to "Next Picture" but the dummy 








field would be generated one further 








picture is discorded. 



5 Table 13 Timestamp MSM registers 

As a result of the synchronization time handling of the present invention, it 
is possible that one of two errors will be generated. 

ERR TOO_EARLY is generated if the decoding is taking place earlier than 
the time indicated by the time-stamp. ERR_TO OJEARLY may be suppressed, but 
10 ERR_TOO_LATE will always be generated unless ail errors are masked out. 

In summary, the present invention includes: an apparatus for synchronizing 
time having, a timestamp for determining presentation time, a clock reference for 
initializing system time in a first circuit, a first time counter in communication with the 
clock reference for keeping system time in a first circuit and a second time counter 
1 5 initialized by the clock reference in a second circuit synchronized with the first time 
counter, for keeping a local copy of the system time and for determining the 
presentation timing error between the local copy of system time and system time by 
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comparing the timestamp to the second time counter. It further includes an 
apparatus for synchronizing a system decoder and a video decoder using a 
timestamp for determining display time, a clock reference for initializing system time 
in the system decoder, a first time counter In communication with the clock 
5 reference for keeping system time in the system decoder and a second time counter 
initialized by the clock reference in the video decoder synchronized with the first 
tone counter, for keeping a local copy of system time and for determining the display 
timing error between the local copy of system time and system time by comparing 
the timestamp to the second time counter. A still another embodiment includes an 
10 apparatus tor synchronizing a first circuit and a second circuit using a clock 
reference for initializing system time in the first circuit, a first circuit having a time 
counter in communication with the clock reference for keeping system time, a first 
% elementary stream time counter in the first circuit for providing elementary stream 

time. The first circuit is adapted to receive a time stamp, and the first circuit 
15 generates synchronization time by adding elementary stream time to the time 
stamp and subtracting system time. The second circuit is adapted to receive 
synchronization time from the first circuit and has a second elementary stream time 
counter in synchronization with the first elementary stream time counter for providing 
a local copy of the elementary stream time and for determining a timing error 
20 between the system time and the time stamp by comparing synchronization time to 
the local copy of elementary stream time. In this way, the clock reference signal 
does not have to be passed directly to the second circuit in order to determine the 
timing error. In another embodiment, an apparatus for synchronizing a first circuit 
and a second circuit has a clock reference for initializing system time in the first 
£ 25 circuit. The first circuit has a time counter in communication with the clock 
reference for keeping system time, and a first video time counter for providing video 
decoding time. The first circuit is adapted to receive a video time stamp and 
generates synchronization time by adding video decoding time to the vidBO time 
stamp and subtracting system time. The second circuit Is adapted tD receive 
30 synchronization time from the first circuit and has a second video time counter in 
synchronization with the first video time counter tor providing a local copy of video 
decoding time and for determining a timing error between system time and the video 
time stamp by comparing synchronization time to the local copy of video decoding 
time. Accordingly, the clock reference signal does not have to be passed directly 
35 to the second circuit in order to determine the timing error. The present invention 
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also includes a method lor providing timing information by providing a video data 
stream having a time stamp earned in packet header wherein the time stamp refers 
to the first picture in the packet of data. In the next step a register is provided 
having a flag used to indicate valid time stamp information which is taken from the 
5 packet header and placed into the register. Next, the timestamp is removed from 
the video data stream and placed in the register. Next, the method encounters a 
picture start and subsequently examines the status of the register to determine if 
valid time stamp information is contained in the register by checking the flag status. 
A time stamp is generated in response to the picture start if the flag indicates valid 
10 time stamp information is contained in the register and then the timestamp is 
inserted back into the data stream. Another embodiment includes an apparatus 
described above wherein the elementary stream time counters are restricted to 16 
# bits. Likewise, there is an apparatus as described above, wherein the second 

elementary stream time counter located in the elementary stream decoder is 
15 restricted to 16 bits. Furthermore, there Is an apparatus as described above 
wherein the synchronization time is restricted to 16 bits for controlling the 
elementary stream decode. The present invention also has a process for decoding 
video and for determining display time errors against a threshold value. It then 
parses video data Into tokens for further processing, determining if a time stamp 
20 token is indicated, comparing the time stamp token to a video time, and generates 
a compared value to determine an indicative of timing error. Next, it determines 
whether the compared value, when compared against a threshold value, is within 
acceptable parameters when a timing error is indicated and indicates when the' 
compared value is outside acceptabie parameters. An alternative embodiment 
£ 25 includes an apparatus for using a system decoder and a video decoder. The 
system decoder is adapted to accept MPEG system streams and demultiplexing 
video data and the video lime stamp from the stream. The system decoder has a 
first time counter representative of system time. The video decoder accepts the 
video data and the video time stamp, and has a second time counter in synchroni- 
30 zation with the first time counter. The video decoder also has a video decoder 
buffer for accepting the video data at a substantially constant rate and outputting the 
video data at a varying rate and for passing a video time stamp. The video decoder 
while decoding a picture from the video data also compares the video time stamp 
for the decoded picture with the second time counter to determine the appropriate 
35 display time. There is also a method for determining a time error between a first 
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circuit and a second circuit by providing the first circuit with a system time (SY), a 
time stamp (TS), and en elementary stream time (ET), obtaining synchronization 
lime (X) by using the elementary stream time(ET), the time stamp (TS) and the 
system time (SY), in accordance with the equation; X=ET + TS-SY, providing 
5 synchronization time (X) to the second circuit and generating a synchronized 
elementary stream time (ET2) and obtaining a time error by using synchronized time 
{X) and in accordance with trie equation ET2-X; hence, the first circuit can be lime 
synchronized with the second circuit without passing system time to the second 
circuit Another method for determining a time error between a first circuit and a 

10 second circuit has the following steps: providing the first circuit wilh a time stamp 
(TS), and an initial timefJT), obtaining synchronization time (X) by using the time 
stamp (TS) and the initial time (IT), in accordance with the equation X=TS-I, 
^ providing synchronization time (X) to the second circuit and generating a synchro- 

nized elementary stream time (ET) and obtaining a time error by using synchronized 

15 time (X) and in accordance with the equation ET-X. In this way, the first circuit can 
be time' synchronized with the second circuit without passing system time to the 
second circuit. Still another method tor determining a time error between a first 
circuit and a second circuit includes the following Steps: providing the first circuit 
with a system time (SY). a video time stamp (VTS), and a video decoding time (VT), 

20 obtaining synchronization time (X) by using the vldeD decoding time (VT), the video 
time stamp (VTS) and ihe system time (SY), in accordance with the equation; 
X=VT4VTS-SY, providing synchronization time (X) to the second circuit and 
generating a video decoding time (VT2) in the second circuit which is synchronized 
to the video decoding time (VT) in the first circuit, and obtaining a time error by using 
£ 25 synchronized time (X) and in accordance with the equation VT2-X. Accordingly, the 
first circuit can be time synchronized with the second circuit without passing system 
time to the second circuit 
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Detafled Description of the Invention for Asynchronous Swing Buffering 
For asynchronous swing buffering, in accordance with the present invention, two 
buffers are operated asynchronously; one is written while the other is read. 
Accordingly, this allows for a data stream having a first rate of through-put to be 

5 resynchronized to another rate, while still maintaining a desired rate. In the 
invention, the write control and read control both have state indicators for 
eommunicafing which buffer they are using and whether the controls are waiting for 
access or are, in fad, accessing that buffer. Each side communicates to the other 
side a single bit to Indicate which buffer it is using. This is the only signal that must 

1 0 be synchronized between the two sides of asynchronous circuitry. 

When one control circuit (read or write) finishes accessing a buffer, then the 
invention will allow control to pass to the other circuit. H, after the control has 
swung, and two control circuits are trying to use the same buffer, then the later 
control circuit will begin wafting. The control circuit will wait until each side is using 

15 alternate buffers, i.e., the other side has swung. If, after it has swung, it finds that 
it is now using the alternate buffer to the other side, it wPl not wait, but immediately 
commence accessing. This system of arbitration between the buffers is started up 
by both buffers using the same buffer, buffer 0, in this case. The read side starts 
up by waiting, while the write side is accessing, since there is nothing valid to read 

20 out of either buffer. 

In one embodiment, in accordance with the present invention, the swing 
buffers are two discrete RAMS having all signals, such ss enabling strobes, 
addresses and data multiplexed from either the read or write side, dependent on 
which buffer is being accessed by each side. This structure has been shown to use 

25 a lot of area in the busing of a large number of signals between the two buffers. 

Combining the two RAMs into a single structure saves much of the busing 
area while still maintaining performance to the same standard. This structure 
contains twice as many rows of cells as one of the discrete RAMs found in the first 
embodiment of the present invention. However, the second embodiment must have 

30 two pairs of bit lines since the read and write to the discrete buffers is happening 
simultaneously and asynchronously. Each row will be of its original width (i.e., have 
the same number of cells) since accesses are the same width as for the discrete 
RAMS. Each pair of rows are accessed as if at the same address, but from different 
buffers, so they connect to a different pair of billines. Using the same address, 

35 these pair of rows can be readily accessed by one row decoder connected to the 
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read address and one row decoder connected lo the write address. Again, the read 
and write control never access the same buffer at the same time so there is no 
conflict as tD which pair is accessed by which row decoder. 

In the same way in which each row decoder can access rows from each 

5 buffer, both the read and write circuitry within the structure of the present Invention 
connect to each pair of biffines, one pairfrom each buffer. The read and writes are 
then multiplexed into each of the buffers and, for the same reasons explained 
above, there will not be conflict 

As shown in Figure 48, a swing unit 1 includes swing buffers 10 with RAM 12 

10 and 14 In accordance with the present Invention. The swing unit 1 also includes a 
write control circuit and a read control circuit, which control the data Into and out of 
the RAM 12 and 14. The read control circuit and the write control circuit accomplish 
this by use of strobes, data and address control lines, 8. Lines 7 and 9 are control 
fines to indicate the RAM used by the write control circuit and the RAM used by the 

15 read control circuit. Line 7 functions to control the write control circuitry, i.e., when 
the rea3 control circuitry is using, RAM 12 if low, RAM 14 if high. Similarly, Line 9 
functions to inform the read control circuitry that the write control circuitry is using 
RAM 12 if low, RAM 14 if high. 

In the present invention, swing buffer 10 has two RAM arrays, 12 and 14. 

20 Swing Buffer 10 is capable of asynchronous, alternative reading and writing to the 
RAM area which enables the apparatus to achieve the necessary band width for 
high speed accessing of the memory. The RAMs 12 and 14 require the foDowing 
signals: write address 16, read address 1 B, data in 20. data out 22; and a read and 
write enable signal (not shown). See also Figure 49. 

25 The write address and read address signals are multiplexed by multiplexers 

24. The RAM array 12 and 14 operate with the write circuitry, row decoder and read 
circuitry in a conventional sense. 

In the first embodiment of the present invention, during initiation of the swing 
buffer 10, RAM 12 will be written to until the control circuitry switches a write enable 

30 single to RAM 14. 

Once the RAM array 1 2 has been written, it falls under the control of the read 
circuitry 4, to be read. During this time, the RAM array 14 is also bsing written. It 
is important to note when the RAM array falls under the control of the read array 
control 2, or the write control circuit 4, the control is established until reading or 

35 writing is completed and then control is turned over. In Ihe situation where the read 
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control circuit 4 is accessing Ihe RAM array, such as 12, and the write control 
circuitry 2 needs to access the same RAM array 12, then the write control circuit will 
begin waiting. 

Therefore, in accordance with the present invention, two control events are 
5 created. When a write control circuit or a read control circuit swings to a different 
RAM, K will either begin immediately accessing the RAM since the RAM is free and 
not under control of the alternative circuit or It will begin to wait. During start up, the 
read side defers to the write side, since there is nothing valid to be read oul of either 

10 The second embodiment of the present invention is shown in Figure 50. An 

integrated swing buffer 30 includes a RAM anay 32 having the logical size of RAM 
array 12 combined with RAM array 14. In other words, there is the same amount 
£ of RAM in both the first and second embodiments, however, it is combined in the 

second embodiment Accordingly, the integrated swing buffer has the advantage 
15 of saving much of the busing area while still performing the same swing buffer 
function. 

In the second embodiment of the present invention, the write circuit and read 
circuit 34 and 36 respectively, are similar to those used in the swing buffer 10. 
However, these circuits now include selectors which choose from the pairs of bit 
20 lines described hereinafter. Likewise, the read access row decoder 38 and the write 
access row decoder 40 are similar to those contained in swing buffer 1 0, however, 
they are able to access a pair of rows as described hereinafter in Figure 51. 

As shown in Figure 51 , the particular structure of the integrated swing buffer 
30, in accordance with the present invention, is detailed. Individual cells 42 are 
m 25 contained in rows 44. The read row decoder 38 and write row decoder 40 access 
the rows 44 in pairs. A pair of rows have the same address provided by the address 
lines 16 and 18. The read buffer line 52 and write buffer line 54 provide the control 
information for selecting one of the paired rows 42. The buffer 0 bitlines 48 and 
buffer 1 bitlines 50 connect to alternative rows of cells and to the read and write 
30 circuitry 34 and 36. For clarity in depicting the addressing, the lighter shading 
illustrates the read row decoder 3B accessing a row in buffer 0. Similarly, the darker 
shading illustrates the write row decoder 40 accessing a row in buffer 1. 

In summary, the present invention includes a swing buffer apparatus having 
at least two RAM arrays, a write control circuit in communication with the RAM 
35 arrays for controlling data input into the-RAM array, and a read control circuit in 
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communication with the RAM an-ays far controlling data output from the RAM arrays. 
Furthermore, the write control circuit and read control circuit are in communication 
with one another to allow a synchronized control of the RAM arrays. There is also 
a swing buffer apparatus having a RAM array, a write control circuit in communica- 
5 tlon with the RAM array through a pair of bit lines, a read control circuit In 
communication with the RAM array through another pair of bit lines and a read row 
decoder and a write row decoder for addressing the RAM through a pair of rows so 
that individual cells are read. The present invention also provides a method of 
asynchronously addressing RAM, by decoding at least a pair of ceils in the RAM, 
10 using a row decoder to decode at least a pair of rows and selecting one of the rows 
to be assessed, using at Isast two pairs of bitlines connected to read a circuit and 
a write circuit and selecting the pair of bitlines to be used. 
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DETAILED DESCRIPTION OF THE INVENTION FOR STORING VIDEO 
INFORMATION 

Video decompression systems contains three basic parts used to decode and 
display picture information. The three main parts of a video decompression system 

5 are the spatial decoder, temporal decode; and the video formatter. The present 
invention involves the temporal decoder and video formatter and the way in which 
the temporal decoder and video formatter manage their respective picture buffers, 
hereinafter the frame store buffer. In MPEG systems, the temporal decoder 
contains two frame store buffers and the video formatter contains two frame store 

10 buffers. 

MPEG uses three different picture types: Intra (I), Predicted (P) and 
Bidirectionally interpolated (B). B pictures are based on predictions from two other 
pictures; one picture is from the future and one from the past. The I pictures require 
no further decoding by the temporal decoder, but must be stored in one of the two 

15 frame store buffers tor later use in decoding P and B pictures. Decoding a P picture 
requires forming predictions from a previously decoded P or I picture. The decoded 
p picture is slored in a frame store buffer for use in decoding further P and B 
pictures. B pidures can require predictions from both of the frame store buffers. 
However, B pictures are not stored in the frame store butlers. 

20 It will be appreciated that I and P pictures are not output from the temporal 

decoder 2s they 2re decoded. Instead, I and P pictures are written Into one of the 
frame store buffers, and they are read out only when s subsequent I or P picture 
arrives for decoding. In other words, the temporal decoder relies on subsequent P 
or I pictures to flush previous pictures out of the two picture buffers. Accordingly. 

25 the spatial decoder of the present invention can provide a fake I or P picture when 
it is necessary to flush the temporal decoder's two frame store buffers. In turn, this 
fake picture is flushed when a subsequent video sequence begins. 

As shown in Table 1-4, the picture frames an: displayed in numerical order. 



30 


Display Order 


11 


Be | B3 


PA |B5 


Be 


P7 


B8 


B9 


110 




Transmit Order 


I 


PA | Bfl 


B3 j P7 


B5 


BS 


MO 


B8 


B9 



Table 14: Frame Stores 
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However, in order to reduce 1he number of frames that must be stored in memory 
by the temporal decoder, the frames are transmitted in a different order. It is useful 
to begin the analysis from an intra frame (I frame). The I frame is transmitted in the 
order it is to be displayed. The next predicted frame (P frame), P4 is then 
5 transmitted. Then, any bi-directionally interpolated frames (B frames) to be 
displayed between the I frame and PA frame are transmitted, represented by Be and 
B3. This allows the transmitted B frames to reference a previous frame (forward 
prediction) or a luture frame (backward prediction). After transmitting all the B 
frames to be displayed between I and P4, the P7 frame is transmitted. Next, all the 
10 B frames to be. displayed between the P4 and P7 frames are transmitted, i.e., 
corresponding to B5 and Bfi. Then, the next I frame, 110, is transmitted. Finally, all 
the B frames to be displayed between the P7 and 110 frames are transmitted. 
• corresponding to BB and B9. This ordering of transmitted frames requires only 2 

frames to be kept in memory by the temporal decoder at any one time, and does not 
15 require the decoder to wail for the transmission of the next P frame or I frame to 
dispia/an interjecting B frame. As described above and shown in Table 14. the 
temporal decoder of the present invention can be configured to provide MPEG 
picture reordering. WUh this picture reordering, the outpul of P end I pictures is 
delayed until the next P or I picture in the data stream starts to be decoded by the 
20 temporal decoder. 

AS the P and I pictures are reordered, certain tokens, i.e. Picture_Start. 
Picture .Type, and Temporal_Reference, are stored temporarily on the chip as the 
pictured written into the picture buffers. When the picture is read out for display, 
these stored tokens are retrieved. At the output of the temporal decoder, the DATA 
M 25 tokens of the newly decoded P or I picture are replaced with DATA tokens for the 
older P or I picture, and they are then sent to the video formatter, Note that the 
output from the temporal decoder is in tokenized macroblock format and there is no 
block-to-raster conversion. 

In brief, the video formatter of the present invention stores two framestores 
30 or pictures. In some video formatters three pictures or framestores are used to 
accommodate such features as repeating or skipping pictures. The video 
formatter's off-chip DRAM holds three framestores. The use of three framestores 
here allows frames to be either repeated or skipped in situations where the frame 
rates of the decoded video and the display are different 
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All I, B and P frames are stored in the framestores of the video formatter. At 
any one time, there may be one frame store from which data is being displayed, one 
frame store into which data is being written, and in video formatters with three 
framestores, one other frame may be being stored in the third frame store. 

5 The present embodiment performs all the prediction, reordering and block-to- 

raster tasks MPEG normally handles by using a temporal decoder with two 
framestores and a video formatter with two framestores, i.e.. for a total of four 
framestores. This is accomplished in the present invention by using a frame store 
sharing scheme that only uses three framestores. The present embodiment cannot, 

1 0 however, handle the repeat and skip frame tasks of a video formatter with only the 
three framestores. 

The present Invention stores I pictures in a first frame store and P pictures 
in a second frame store. Because of Ihe need to perform the block-to-raster 
conversion, B frames are stored in the manner detailed below in a third frame store. 

15 . In order to minimize the amount of external DRAM required, a scheme is used 
where successive B frames share the same third frame store. 

When a B frame is decoded, it may refer to the two previously decoded I or 
P frames occupying the first and second framestores. The decoded B frame is 
written into the third frame store. The present embodiment allows the raster to 

20 commence prior to h frame store being completely filled. The raster is allowed to 
start before the frame store is filled so that the next B frame can be written into the 
same frame store to occupy thB space vacated by the raster at the top of the 
previous frame. 

In order to keep a record of which parts of the frame store are occupied with 
25 picture data, and which are available for new data, each frame store Is split into 
sectors. In the present invention, each frame store is first split into two field stores, 
each of which comprises-N sectors, where N is the number of block rows in the field. 

Frames coded as field pictures are straightforward. Each successive 
macroblock row occupies two sectors in a field store. Once the write back has 
30 progressed far enough down the frame, the raster starts reading out each sector 
from the top. Once the write back of the first frame has been completed, the start 
of the next frame is written into the space left by the raster. Checks on the status 
of each of the sectors ensures that the sector to be rastered is indeed full, and that 
for write back, the two sectors required are empty. 
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Frames coded as frame pictures are more difficult. Unlike field pictures, the 
macroblock rows of data are not written to the DRAM in the same order as they are 
to be rastered. The field stores are written to in parallel, whereas the fields are 
rastered in tum. 

Consider a picture with 8 sectors per field store. That is. Field store 0 
consists of 8 sectors numbered 0 to 7, each of which contains one row of bbeks 
(i.e., each 8 pixels deep by the width of the picture). Field store 1 consists of 8 
sectors, numbered 8 to 1 5, each of which contains one row of blocks (i.e., each 8 
pixels deep by the width of the picture). 

The first macroblock row is written back into sector 0 in field store 0 and to 
sector 8 in field store 1. The field stores continue to be filed in parallel. At some 
point, the raster beings displaying sectors from field store 0, that point being chosen 
so that the raster of field store 0 does not catch up with the write back. However, 
the second frame cannot be written back h the same manner as the first. Because 
the sectors aie written and read in a different order, wailing for the same two sectors 
to be free at the start of a frame would mean that write and read could not run 
continuously. This must be achieved in order to maintain the display and to 
maintain decoding at the necessary rate. 

Accordingly, the second frame must be written into sectors of the frame store 
already freed by the raster. This is implemented by dividing the framestores in two. 
Hence, for the second frame, the meanings of the half field stores change. Sectors 
4-7 become the upper part of the second field store and sectors B-1 1 become the 
lower part of the first field store. i.e.. they swap over. The first macroblock row is 
written to sectors 0 and 4, once they are freed, with subsequent rows written lo 1 
and 5, then 2 and 6, and then 3 and 7. The next row is written to sectors 8 and 12, 
and so on through to 11 and 15. This reallocation lo the memory is sufficient to 
allow the write back and raster to continue at the appropriate rate. 

Should a third successive B frame arrive, the write back order reverts to that 
of the first frame. 

In the shared B frame store, with FRAME pictures: 
The FIRST picture is written back to - 
Sectors 0 and 8 [1st macroblock row=2 block rows] 
Then 1 and 9, 2 and 10, 3 and 11, ... 7 and 15. 

The FIRST picture is rastered from - 
Sector 0. 
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Then 1, 2. 3, 4. 5, 6. 7, 8. 9. 10. 11. 12. 13. 14. 15. 
The SECOND frame is written to - 
Sectors C and 4. 

Then 1 and 5, 2 and 6, 3 and 7, 8 and 12. 9 and 13. 10 and 14, 1 1 and 15. 
5 The SECOND frame is rastered from - 

Sector 0, 

Then 1, 2. 3 B, 8. 10. 11. 4. 5. 6.7. 12. 13. 14. 15. 

Note that, in accordance with the present invention, the second frame, the 
first macroblock row is not written into sectors 0 and 1, which are, after all, the first 
10 two sectors to be freed by the raster. Instead, it waits for sector 4 to clear. This is 
done for two reasons: First, waiting for sector 4 to dear does not affect the system's 
ability to maintain continuous decoding and display, even in the situation of worst- 
^ case coded data, and it is easier to implement. Secondly, with picture sizes which 

divide into a number of sectors that are not a power of two. the sequence for writing 
15 to and reading from sectors of memory does not repeat often (for example. NTSC 
format has 30 sectors par field and the sequence would repeat every 5B frames). 
This makes testability and recovery difficult. 

As far as implementation is concerned in the present invention, rather than 
keep a record of the status of each individual sector, each half field store is 
20 effectively implemented as a frfo, with pointers to the next location to be written and 
to be read. Thus, each fifo being full or empty causes write back and raster, 
respectively to be disabled. This makes use of the knowledge that each half field 
store is Itself written and read only one way. just like a fifo. 

In summary, the present invention, provides method for storing video 
0 25 information by providing video information in the form of an I Freme, a P Frame, a 
B, Frame and a B2 Frame, storing the I Frame in a first Frame store, storing the P 
frame in a second frame store; providing a third Frame store having a first and 
second field store, the first and second field store being split into at least two 
memory areas respectively, storing the B, Frame in the third register, reading the 
30 B, Frame from a selected portion of the memory area in the first or second field 
store; writing a portion of the B2 Frame into the selected portion of the memory area 
from which the B, Frame was read; whereby a reduced amount of memory can be 
used to store video information. 

The two programs found herein below contain code to be used in the 
35 preferred embodiment of the invention. - 
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Detailed Description of the Invention for a Parallel Huffman Decoder 
In accordance with the present Invention, the Parallel Huffman Decoder block will 
decode Huffman coded Variable Length Codes (VLCs] and Fixed Length Codes 
(FLCs), and pass through tokens under the control of the parser microprogramma- 
5 ble state machine (MSM). 

This embodiment of the present invention handles both MPEG-2 as well as 
MPEG-1 Huffman codes. An important aspect of this embodiment of the invention 
is that it can sustain a high through-put due to the fact that it Is a parallel decoder 
rather than a serial one. 
10 Thie embodiment of the present invention uses a code lookup technique to 

decode Huffman codes. This is done to achieve the performance requirements and 
aiso to handle the second MPEG-2 transform coefficient table which is irregular or 
^ non-canonical in nature. 

Furthermore, this embodiment of the invention has some features that allow 
15 it to decode certain more complex components from the stream in a single cycle 
without' the assistance of an external controller. Examples of such complex 
components are Escape-coded coefficients, Intra-DC values and Motion Vector 
deltas, all of which are present in the stream as combined VLC/FLC components. 
Referring now to Figure 52, there is shown how the Parallel Huffman Decoder 
20 300 deals with variable length codes (VLCs). FLCs require a bypass mechanism 
which uses the selector 301 output to generate data and an input field to specify the 
length of the FLC. Thus, the ROW 302 is not required at all during FLC decoding. 

However, to decode a VLC, input is first loaded into the two input data 
registers, 'MSReg' and 'LSReg' as shown in Ffcjure 52. As the names imply, the 
£ 25 "earlier" or most significant data is stored in MSReg. The selector is used to align 
the beginning of the next VLC with the ROM input. Thus, to decode the very first 
VLC, the selector outputs the top 28 bits of Its 59-bit inpul and the top IB bits of 
these are passed to the Huffman Code ROM 302. For subsequent VLCs, the 
selector effectively shifts the input according to the total count of bits decoded thus 
30 far. The count is maintained by adding the size of each VLC, as it is decoded, to a 
running total. The various word widths are a result of the maximum coded size 
which can be decoded, which is the 28-bit MPEG-1 Escape Coded Coefficient, and 
the maximum VLC size which is 16 bits (DCT coefficient tables). 

The "table select" input is used to select between the various different 
35 Huffman code tables required by MPEG." 
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Tn<?Hvffmgn Co-deRQM 
The core of the implementation of the present invention, used to decode all the 
VLCs is a special ROM 302 whose addresses are controlled with a selector/shifter 
301 as shown in Figures 52 and 53. The ROM 302 has the job ot performing a VLC 
5 table index calculation, fallowed by the Index-to-data operation that yields decoded 
data. 

The index calculation can be thought of as a content addressable memory 
(CAM) operation with "dont care* matching implemented to handie the Huffman 
codes which form the presented data. Since all the VLC code tables are fixed, a 

1 0 CAM-ROM will suffice and this is the job of the ROM AMD-plane shown in Figures 
54 through 57. Since the index generation is performed in a look-up manner (rather 
than algorithmically) there is no restriction to handling tables which are canonical. 

The ROM Or-plane converts the "Index" (an activated word-line) into the 
decoded data and the si2e (or length) of the code. The data forms the decoded 

15 output (subject to error checking) and the size Information is fed back to allow a 
calculation to be performed which controls the selector and, thus, presents the 
decoder ROM 302 with the correct data to perform the decoding of the next VLC in 
the subsequent cycle. 

The ROM 302 address of the present invention is in two fields. The larger 

20 field is the bit-pattern to be decoded and the smaller field selects which Huffman 
code table is to be examined. The bit-pattern which must be examined is quite long, 
16 bits, corresponding to the longest VLC code and there is an additional 4 bits of 
table select. Thus, there is a total address space of 20 bits (approximately one 
million addresses) although there are only in 450 entries in the ROM 302. The 

25 reason for the difference is due to the existence of "don't care" bits, 

In order to decode VLCs, the AND-plane must be able to decode "don't care" 
bits in the VLC bit-pattern. This is because all VLCs which are shorter than the 
maximum 1 8 bits will be followed by additional bits which form no part of the 
decoding of that VLC. Because of the wide address, the AND-plane is predecoded 

30 (2->4), and the ROM 302 must combine "don't care" handling with this predecode. 
Furthermore, in addition to the complete MPEG code tables, the ROM 302 also has 
entries to identify illegal VLC patterns, which exist for some code tables. 
|yl3Ximiziog Throughput 
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In order to sustain output of one decoded item every cycle, some care must be 
taken to control the decoder input and special handling must be used for some 
"complex" symbols (/.e., ones which are not single FLCs or VLCs). 

In orderto sustain peak throughput of Escape-coded coefficients it must be 
5 possible to Input at least one complete code per cycle. Since the maximum length 
required is 28 bits in MPEG-1 this dictates the input word width of 32 bite (being the 
next sensible size greater than 28). 

Normal transform coefficients are also "complex* symbols, in the sense that 
they consist of a VLC followed by a 1-blt FLC which gives the sign of the level value 
10 and are handled In a similar manner to the other complex symbols (e.g. motion 
Vectors, Intra DC and Escape coded coefficients). Peak throughput cannot be 
achieved if coefficients are decoded as a VLC followed by an FLC (in separate 
0 cycles) and the alternative'of allowing the ROM 302 to decode the sign bit would 

double the size of the two largest tables in the ROM. Thus in the present invention. 
1 5 special handling is used for various symbols so that a single cycle can produce the 
■final" required result. 
Fi r,s pnd Tokens 

The basis of FLC handling is to control the selector with the required length of the 
FLC and to bypass the ROM 302 and simply output the correctly selected FLC. 
20 Thus, simple FLCs are handled fairly naturally by the decoder, withoul significant 
extra hardware. Furthermore, tokens are not manipulated, but simply passed 
directly to the output of the decoder. 
Implementation 

This section describes several important features of the implementation of the 
0 25 decoder., in accordance with the present invention. The implementation includes 
the arrangement of registers with the counter 303 and selector 301 . as shown in 
Figure 52, and the actual code ROM. 

The schematic of Figure 53 shows how the core components are intercon- 
nected to implement the main Huffman decoding core section of the present 

30 invention. The registers ni5[31:0] and ls[31:0] are MSReo and LSReg, respec- 
tively, and the block phselect is the selector. The counter logic is contained in the 
block phcclog (together with various other logic) and the count latch is called 
cntl[4:0]. The other logic on this schematic deals with handling commands, data 
and command dynamics, tokens, and the manipulation of the more "complex" 

35 symbols (performed in block phcop). - 
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The schematic shown in Figure 54 illustrates a very small sample ROM 
design of the type used to implement the Huffman code ROM 302 in accordance 
with the present invention. The unusual features of this ROM 302 lie in the AND- 
plane where predecode and "don't care" handling are used to implement a method 

5 of decoding variable length Huffman codes. 

Referring now to Figures 55, 56 and 57 and, more particularly to Figure 55, 
there is shown a first embodiment of a ROM AND-plane capable of "donl care" 
handling. In this embodiment, each address line (a[3], a[2], a{1] and a[0]) is driven 
across the AND-plane in both Its true and inverted directions. To decode a "one" 

10 or a "zero" on a jjlven •address line, a transistor is connected to either the true or 
inverted address line in the conventional manner, in order to decode a 'don't care" 
(denoted by x) a transistor is not connected to either the true or the inverted line. 

Figures 56 and 57 show alternative embodiments that utilize pre-decoding 
to reduce worst<ase number of series transistors in the decoding logic. In these 

15 examples, two address bits are combined together in predecoding such that Dne of 
four lines is driven high for each of Ihe four possible numbers that can be 
represented with the two address bits. It will be appreciated by one of ordinary skill 
in the art that the present invention would work equally well with higher levels of 
predecoding in which more than two bits are combined together. If the two address 

20 bits that are grouped together in the predecoding have defined values (either 1 or 
2ero. but no1 the "dont care") then a transistor is connected tD the appropriate 
predecoded address line in the conventional manner. Similarly, if both of the 
address bits have a "don't care", then no transistor Is used as before. However, if 
one of the address bits needs to have a defined value (1 or zero) whilst the other 

25 address bit requires "don't care", then the decoding requires that the wordline driven 
across the Or-plane be selected when either of two of the pred ecoded address tines 
is active. In the embodiment shown in Figure 56, this is achieved by placing two 
transistors, one on each of the reievanl predecoded address lines, in parallel as 
shown in the case for the code; 001x. In the embodiment shown in Figure 57 the 

30 required decoding is achieved without using a parallel connection of transistors. In 
this case, two separate decodes are performed both of which must be selected. 
They are combined together using s NOR gate in the wordline driver such that the 
wordline is only activated if both of the selects are active. 

The foregoing description is believed to adequately describe the overall 

35 concepts, system implementation and operation of the various aspects of the 
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invention in sufficient detail to enable one of ordinary skill in the art to make and 
practice the invention with all of its attendant features, objects and advantages. 
However in order to facilitate a further, more detailed in depth understanding of the 
invention, and additional details in connection with even more specific, commercial 
5 implementation of various embodiments of the invention, the following further 
description and explanation is proffered. 

Note that additional Figures, which are self explanatory to those of ordinary 
skill in the art, are Included with this application for providing further insight Into the 
detailed structure and operation of the environment in which the present invention 
1 0 is intended to function. 

The afored escribed pipeline system Df the present Invention satisfies a long 
existing need for further improvements in various aspects of video decoding 
^ systems, including an MPEG video decompression method and apparatus utiSzing 

a plurality of stages Interconnected by a two-wire interface arranged as a pipeline 
1 5 processing machine. Control tokens and DATA Tokens pass over the single two- 
Wire interface for carrying both control and data in token format A token decode 
circuit is positioned in certain of the stages for recogni2ing certain of the tokens as 
control tokens pertinent to that stage and for passing unrecognized control tokens 
along the pipeline. Reconfiguration processing circuits are positioned in selected 
20 stages and are responsive to a recognized control token for reconfiguring such 
stage to handle an identified DATA Token. A wide variety of unique supporting 
subsystem circuitry and processing techniques are disclosed for implementing the 
system, including memory addressing, transforming data using a common 
processing block, time synchronization, asynchronous swing buffering, storing of 
25 video information, a parallel Huffman decoder, and the like. 

It will be apparent from the foregoing that, while particular forms of the 
invention have been illustrated and described, various modifications can be made 
without departing from the spirit and scope of the invention. Accordingly, it is not 
intended that the invention be limited, except as by the appended claims. 
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We CLAIM: 

1. An apparatus for synchronizing time, comprising: 
a time stamp for determining presentation time; 

a clock reference for initializing system time in a first circuit; 
5 a first time counter in communication with said clock reference for keeping 

system time In a first circuit; and 

a second time counter initialized by said dock reference in a second circuit 
synchronized with said first time counter, for keeping a local copy of said system 
time and for determining the presentation timing error between said local copy of 
10 system time and said system time by comparing said time stamp to said second 
time counter. 

2. An apparatus for synchronizing a system decoder and a video 
decoder, comprising: 

a system decoder; 

a time stamp for determining display time; 
5 a clock reference for initializing system time in said system decoder; 

a first time counter in communication with said clock reference for keeping 
system time in said system decoder; and 

a second time counter initialized by said dock reference in said video 
decoder synchronized with said first time counter, for keeping a local copy of system 
io time and for determining the display timing error between said local copy of system 
time and said system time by comparing the time stamp to said second time 
counter. 

3. An apparatus for synchronizing a first circuit and a second circuit, 
comprising: 

a dock reference for initializing system time in a first circuit, said first circuit 
having a time counter in communication with said clock reference for keeping 
5 system time; 

a first elementary stream time counter in said first circuit for providing 
elementary stream time; 

said first circuit being adapted to receive a time stamp, and said first circuit 
adapted to generate synchronization time by adding elementary stream time to said 
io time stamp and subtracting system time; and 

said second circuit being adapted to receive synchronization time from said 
first circuit and having a second elementary stream time counter in synchronization 
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with said first elementary stream time counter for providing a local copy of said 
elementary stream time and for determining a timing error between said system time 
15 and said time stamp by comparing synchronization time to said local copy of said 
elementary stream time; 

whereby said clock reference signal does not have to be passed directly to 
said second circuit In order to determine timing error. 

4. An apparatus for synchronizing a first circuit and a second circuit, 
comprising: 

a clock reference for initializing system time in a first circuit; 
said first circuit having a time counter in communication with said clock 
5 reference for keeping system time; 

a first video time counter for providing video decoding time; 
0 said first circuit being adapted to receive a video time stamp and generate 

synchronization time by adding video decoding time and video time stamp and 
subtracting system time; and 
io said second circuit being adapted to receive synchronization time from said 

first circuit and having a second video time counter in synchronization with said first 
video time counter for providing a local copy of videc- decoding time and for 
determining a timing error between said system time and said video time stamp by 
comparing said synchronization time to said local copy of video decoding time; 
is whereby said clock reference signal does not have to be passed directly to 

said second circuit in order to determine timing error. 

5. A method for providing timing information, comprising the steps of: 
providing a video data stream having a time stamp carried in packet header 

0 said time stamp referring to the first piclure In a packet of data; 

providing a register having a flag for indicating valid time stamp information 
5 which is taken from said packet header and placed into the register; 

removing said time stamp from said video data stream and placing it in said 
register; and 

encountering a picture start and subsequently examining the status of said 
register to determine If valid time stamp Information is contained in said register by 
checking flag status. 

6. A process for decoding video comprising the steps of: 
determining display time errors against a threshold value; 
parsing video data into tokens forfurther processing; 
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determining if a time stamp token is indicated; 
5 comparing the time stamp token to a video time; 

generating a compared value to determine an indication of timing error; 
determining whether the compared value, when compared against a 
threshold value, is within acceptable parameters when a timing error Is Indicated; 

indicating when the compared value is outside acceptable parameters. 

7. An apparatus for using a system decoder and a video decoder, 
comprising: 

a system decoder adapted to accept MPEG system streams and 
demultiplexing video data and a video time stamp from a stream; 
s said system decoder having a first time counter representative of system 

^ time; 

a video decoder for accepting said video data and said video time stamp; 

said video system having a second time counter in synchronization with said 
first time counter, and 
10 said video decoder also having a video decoder buffer for accepting said 

video data at a substantially constant rate and oulputting said video data at a 
varying rate and for passing a video time stamp. 

8. A method for determining a timing error between a first circuit and a 
second circuit, comprising the steps of: 

providing the firsl circuit with a system lime (SY), a time stamp (TS), and an 
elementary stream time (ET); 
5 obtaining synchronization time (X) by using the elementary stream time (ET). 

£ the time stamp (TS) and the system time (SY), in accordance with the equation, 

X=ET + TS-SY: 

providing synchronization time (X) to the second circuit; and 
generating a synchronized elementary stream time (ET2); 
1 0 obtaining a timing enror by using synchronization time (X) and in accordance 

with the equation ET2-X; 

whereby the first circuit can be synchronized with the second circuit without 
passing system time to the second circuit. 

9. A method for determining a timing error between s first circuit and a 
second circuit, comprising the steps of. 

providing the first circuit with a time stamp (TS), and an initial time (IT; 
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obtaining synchronization time (X) by using the time stamp (TS) and the initial 
5 time (IT), In accordance with the equation X=TS-I; 

providing synchronization time {X) to the second circuit; 
generating a synchronized elementary stream time (ET); and 
obtaining a timing error by using synchronization time (X) and in accordance 
with the equation ET-X; 
10 whereby the first circuit can be time synchronized with the second circuit 

without passing time to the second circuit. 

10. A method for determining a timing error between a first circuit and a 
second circuit, comprising the steps of: 

providing the first circuit with s system time (SY), a video time stamp (VTS), 
and a video decoding time (vT); 
W 5 obtaining synchronization time (X) by using the video decoding time (VT), the 

video time stamp fVTS) and the system time (SY), in accordance with the equation, 
X=VT+VTS-SY; 

providing synchronization time (X) to the second circuit; 

generating a video decoding time (VT2) in the second circuit which is 
synchronized to the video decoding time (VT) in the first circuit; and 

obtaining a timing error by using synchronized time (X) and in accordance 
with the equation VT2-X; 

whereby, the first circuit can be time synchronized with the second circuit 
without passing system time to the second circuit. 

11. A method tor addressing memory, comprising the steps of: 
providing a fixed width word having a predetermined fixed number of bits to 

£ be used for addressing variable width data; 

defining the fixed width word with a width defining field and an address field; 
5 providing the width defining field with at least one bit to serve as the 

termination marker, 

defining the address field with a plurality of bits defining the address of the 

data; 

varying the size of bits in the address field in inverse relation to the size of the 
10 variable width data; 

varying the number of bits in the width defining field in direct relation to the 
size of the variable width data; and 
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maintaining a fixed width word for addressing variable width data while 
varying the width of the width defining field and the address field. 

12. A method for addressing memory, comprising the steps of: 
providing a fixed width word having a predetermined fixed number of bits to 

be used for addressing data; 

defining the fixed width word with an address field and a substitution field; 
5 defining the address field with a plurality of bits defining the address of the 

data; 

defining a variable width substitution field with at least one substitution bit; 

the substitution field having at least one bit to serve as a termination marker 
between the address field and the substitution field; 
10 using the substitution field to indicate substituted bits from a separate 

addressing source; and 

maintaining a fixed width word for addressing variable width data while 
inversely varying the width of the address field and the width of the substitution field. 

1 3. A method for addressing variable width data In a memory, comprising 
the steps of: 

providing memory having words of predetermined width and composed of 
partial words; 

5 rotating the partial word to be accessed to at least significant bit justification; 

extending remaining part of the word so that the accessed word will be 
recognized as the partial word; 

restoring the remaining part of the word; and 

rotating the word until the partial word is restored to its original position. 

14. A parallel Huffman decoder, comprising: 
a selector; 

a pair of input register s for receiving Huffman coded data, both of said 
registers directing input in parallel to said selector; and 
5 a Huffman Code ROM for receiving input from said selector and another 

ROM table select input; said ROM providing decoded data output. 

15. A RAM interface for connecting a bus to RAM, comprising : 
means for receiving from a bus a plurality of data words, and buffering the 

received data words; 

means for receiving from said bus an address associated with said plurality 
5 of data words; 
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means for generating a series of addresses in RAM into which the buffered 
data words will be written, the series of addresses being derived from the received 
address; and 

means for writing said buffered data words into RAM at the generated 
addresses. 

16. A RAM interface for connecting a bus to RAM, comprising: 

a plurality of data words stored In RAM at predetermined addresses; 
means for receiving from a bus a RAM address associated with said plurality 
of data words; 

5 means for generating a series of RAM addresses for addressing said plurality 

of data words in said RAM, the series of addresses being derived from the received 

means forbuffering data words read from said RAM; and 
means for reading from said RAM said plurality of data words, using said 
10 series of RAM addresses generated by said address generating means, and writing 
said data words into said buffer means. 

17. A method for controlling the buffering of encoded video data organized 
as frames, comprising: 

determining the picture number of a frame; 
determining the desired presentation number of said frame; and 
s marking a buffer as ready when said picture number is on or after said 

desired presentation number. 

18. An apparatus for transforming data, comprising: 

A first latch defining a fust data stream source and a second latch defining 
a second data stream source; 

said first and said second latches being In communication with an arithmetic 

said arithmetic unit communicating data to a transposes 

said transposer transposing and communicating said data to said second 

latch; 

said second latch being arranged to absorb data; and 
10 said second latch and said first latch communicating said first and second 

data streams in an interleaved manner to said arithmetic unit, further defined that 
in said communication in the interleaved manner said second latch does not 
interrupt communication from said first latch; 
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whereby a common arithmetic unit is used for said first and said second data 
streams, 

19. A process for transforming data using a common arithmetic unit, 
comprising the steps of: 

loading the data in a first latch and upon reaching a predefined number of 
cycles transmitting the data to the arithmetic unit and loading a first maker bit into 
5 a control shift register 

loading data into a second latch, the second latch being adapted to absorb 

data; 

transmitting the data in the second latch to the arithmetic unit when the first 
control shift register reaches a predetermined state and the second latch is tilled 
io with a predetermined amount of data; 
9 failing to transmit data from the second latch , if the second latch Is not filled 

with a predetermined amount of data; and 

recovering the second latch when the first latch is receiving non-data. 
ZD. A swing buffer apparatus, comprising: 
at least two memory arrays; 

a write control circuit in communication with said memory arrays for 
controlling data input into said memory arrays; 
s a read control circuit in communication with said memory arrays for 
controlling data output from said memory arrays; and 

said write control circuit and said read control circuit being in communication 
to allow a synchronized control of said memory arrays. 

21 . A method of asynchronously accessing cells in a memory, comprising 
^ the steps of: 

using a decoder to decode at least a pair of cells; and 
reading one of the cells and writing to the other of the cells. 

22. A method for storing video information, comprising the steps of: 
providing video information in the form of an I Frame, a P Frame, a B, Frame 

and a Bj Frame; 

storing the I Frame in the first Framestore; storing the P frame In a second 
5 framestore; providing a third Framestore having a first and a second field store, the 
first and second field store being split into at least two memory areas respectively ; 
and 
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storing the E, Frame from a selected portion of the memory area In the ftrsl 
or second field store; writing a portion of the B 2 Frame into the selected portion of 
io the memory area from which the B, Frame was read; 

whereby a reduced amount of memory can be used to store video informa- 
tion. 

23. A memory for "dont care" handling, compnsing: 

a set of memory address lines, inverted address lines and data lines, said 
address lines and inverted address lines being connected according to a decoding 
format to access the addressed information in the form of a data word, "dont care" 
5 address locations on the data lines being unconnected with the associated address 
lines and said inverted address lines. 

24. A method of accessing Dynamic Random Access Memory (DRAM) to 
store and retrieve data words associated with a two dimensional Image, the DRAM 
including two separate banks, each bank being capable of operating in page mode 
to read and write the data words, the two dimensional image being organized in two 

5 dimensional grid pattern of calls, each cell containing an M by N matrix of pixels, 
and the words associated with each cell occupying one page or less of a bank, the 
method comprising the steps of: 

(a) assigning each cell a particular one of the two banks so that all 
data words associated with that particular cell are read from and written to one 

ic particular page of that particular bank, the assignment of banks to cells being done 
such that each cell is associated with a different bank than any bordering cell which 
is also either in the same row or in the same column; and 

(b) reading the data words associated with a cell that is composed 
of a matrix of pixels, and that is not aligned with the two dimensional grid pattern, 
but that is aligned with pixels in cells in the two dimensional grid pattern. 

25. A method for accessing Dynamic Random Access Memory (DRAM) 
to store and retrieve data words associated with a two dimensional image, the 
DRAM including two separate banks, each bank being capable of operating in page 
mode to read and write the data words, the two dimensional grid pattern of cells, 

S each cell containing an M by N matrix of pixels, and the words associated with each 
cell occupying one page or less of a bank, the method comprising the steps of; 

(a) assigning each cell a particular one of the two banks so that all 
data words associated with that particular cell are read from and written to one 
particular page of lhat particular bank, the-assignment of banks to cells being done 
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10 such that each cell Is associated with a different bank than any bordering eel! which 
is also either in the same row or in the same column; and 

(b) reading the data words associated with a cell that is composed 
of an M by N matrix of pixels, and that is not aligned with the two dimensional grid 
pattern, but that is aligned with pixels In cells in the two dimensional grid pattern. 

26. The method of claim 63, wherein the DRAM includes a first and 
second bank, and the step (b) of reading the data words associated with the 
unaligned cell includes the steps of: 

(e) reading, from the first bank of DRAM, the data words 
s associated with one of the cells in the grid pattern containing data words associated 
with the unaligned cell; 

<d) reading, from the second bank of DRAM, the data words 
associated with another of the cells In the grid pattern containing data words 
associated with the unaligned ceB; 
1 0 (e) repeating steps (c) and (d) until all the data words associated 

with the' unaligned cell have been read. 

27. A method of accessing from RAM a number M of words that is less 
than the predetermined fixed burst length N of the RAM. the RAM including an 
enable line that selectably enables and disables reading from and writing to the 
RAM, the method comprising the steps of: 

5 ordering N words to be read from or written to the RAM; 

determining when M words have been rad from or written to the RAM, M 
being less than N; and 

disabling the RAM upon determining M words had been read from or written 
to the RAM. 

28. A method of reading from RAM a number M of wotfs that is less than 
the predetermined fixed burst length N of the RAM, the RAM including an enable 
line that selectably enables and disables reading from the RAM. the method 
comprising the steps of: 

S ordering N words to be read from the RAM; 

determining when M words have been read from the RAM, M being less than 

N; and 

disabling the RAM upon determining M words had been read from the RAM. 

29. A method of writing to RAM a number M of words that is less than the 
predetermined fixed burst length N Of the RAM, the RAM including an enable line 
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that seleetably enables and disables writing to the RAM, the method comprising the 
steps of: 

; ordering N words to be written to the RAM; 

determining when M words have been written to the RAM, M being less than 

N " ^disabling the RAM upon determining M words had been written to the RAM. 
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The following more detailed description of the system of the present invention is set forth 
for purposes of organization, clarity and convenience of explanation under the headings 
fisted below. 

Overview 

Start Code Detector ; . . 

Parser 

Spatial Processing 

Predictions 

Display Circuitry 

Parallel Stan Code Detector (sedp) 

Input Fito 

Input Circuit 

Start Codes " ' 

Removal of bit stuffing .. ... 

Search modes \ ' 

Non-alignefl start codes 

Overlapping Start Codes 

Unrecognized Start Codes 

Extension and User Data 

Insertion of P1CTURE_END Tokens . . . . 

Slop After Piclure Interrupt 

discard_all 

Access Bit 

Tokens Recognized by sedp 

Scdp Memory Map 

Implementation 

Dataflow Around the Coded Data Buffer 

Theory of Operation 

Discontinuities 

Start-up \] 

Embodiment ' 

Hardware 

MSM handling of Time-Stamp Information ' 

Slart-Up 

MSM Time-stamp error codes , . . 

Support for 30 Hi 

Introduction 

State Machine " 

Jumps end Calls [ 

Interrupts and errors . , 

Jump addresses . . . 

State Machine internal instructions . . , . . 
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State Machine testing 

State Machine ucode map 

State Machine ucode word 

Arithmetic Core 

ALU 

Shift block 

Cany block 

Condition block 

ALU core 

ALU ucode word 

Use of the ALU 

Register File 

Register file addressing 

Register file register types 

Register file address map 

Register file ucode word 

Token Port 

^ Token Port ucode word 

Multiplexers 

UPI Memory Map 

Introduction 

Interfaces 

Functional Description 

Timing requirements 

Microprocessor Interface Access 

Introduction 

Interfaces 

Functional description 

Mal-formed tokens 

Zig-zag scan paths 

R2sler scan orcer 

Microprocessor Interface Access 

Introduction 

A Prediction in frame pictures 

Frame-based prediction 

Field-based prediction (in a frame picture) 

Dual prime (in frame pictures) ' 

Prediction in field pictures 

Field-based prediction 

16x6 MC 

Dual prime in field pictures 

Overall organization 

Horizontal Upsampler 
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Introduction 

4:3 Upsampling 

3:2 Upsampling 

2:1 Upsampling 

Boundary Effects 

The number of output pels . . . 

Position signals 

Multiplexed data 

Horizontal Alignment 

Upsampling ratio 

Video Timing Generator 

Introduction 

Horizontal Timing 

Vertical Timing - PAL 

Vertical Timing - NTSC 

VTG Structure 

Horizontal Machine 

Vertical Machine 

Hardwired Comparator Design 

Output multiplex . . 

Border generation 

Vertical Border 

UP! controls 

Output multiplex 
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Overview 

This detailed description deals with trie present invention as an entire chip. Referring now 
to Figure 58, there is shewn a very nigh level block diagram of the system. In subsequent 
sections, each block is expanded to provide a more detailed block diagram. 

This description accurately documents all of the interfaces between the various functional 
blocks of circuitry. This should allow each block Id be designed with a complete 
knowledge of the interfaces that it is expected lo provide. 

As shown in Figure 58, the primary system components include clock generator 350, a 
start code detector 201 , a parser 202. a microprocessor interface 320. a memory control 
subsystem 352. a spatial processing subsystem 351, e predictions subsystem 208 and a 
display 355. Figure 58 further illustrates the interfacing that occurs between the various 
system components. 



Start Code Detector 

Figure 59 shows the start code dstedor 201 (SCD) inlerf aces with other blocks of circuitry 
of the system in accordance with the present invention. 

The SCD 201 can be thought of as providing three distinct functions. First, the SCD 201 
provides an input circuit that receives data either from dedicated pins or from the MPI 320 
£ Second, the SCD 201 detects start codes in the data, and third, the SCD provides the 
necessary rircuftry to assemble the incoming data into a formal to be used internally within 
the coded data buffer (CDS; 321 . 
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Parser 

Figure 50 Illustrates the parser subsystem, in accordance with the presenl invention. Data 
which was formatted for the CDB 321 is unpacked and passed to the parser which receives 
instructions from the MPI 320. Thereafter, the data is passed via a two-wire interface to 
the rest of the system. 



Spatial Processing 

Figure 61 illustrates the components of the spatial processing circuitry. These components 
include an inverse modeler (Imodel) 325. an inverse zig-zag (IZZ) 326 and inverse 
quantizer (Iquant) 327 and an inverse discrete cosine transfer (IDCT) 328. The data 
passes into the Imodel 325. then to the 122 326, nexl to the Iquant 327 and then to the 
IDCT 328. 



£ Display Circuitry 

The display circuitry of the present invention is shown in Figure 62. This system includes 
a vertical upsampler 210, a horizontal scale subsystem 331 , an output multiplexer 332 and 
a video timing generator 333. 
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Parallel Start Code Detector (scdp) 

The start code detector 201 , in accordance with the present invention, is a parallel start 
code detector, i.e., it passes data in parallel. This system is similar to that previously 
disclosed in British Application Serial Nc 9405914.4 filed March 24, 1994, and EPO 
Application Serial no. 92306036.8 filed June 30, 1992, (hereinafter "Brolly").' However 
several mejor differences exist between the two start code detectors. First, byte alignment 
is assumed. There is no shifting of the data in order lo find start codes in the present 
invention. Second, the present invention operates primarily with MPEG data. 

An MPEG (1 end 2) start code consists of a unique bit (byte pattern) in the bit stream 
known as the start_eode_prefix. The pattern is 23 zeros followed by a one. The 6 bits 
immediately following the start_code_prBfix is known as the start code value. This 
indicates the type of the start code. Start codes arriving at the SCD of the present 
invention are required lo be byte aligned. Accordingly, the above data can be specified 
as e byte sequence. For example: 




0x01 
OxbB 

Is a group^stsri code. 



Input Ftfo 

The present invention is designed such thai given s peak data rate of 25D Kbytes/s and 
assuming that the coded dais buffer does not overflow, the in_acccpt pin will never be 
pulled Idw. Hence, to calculate the length of the input fifo, il is necessary to know: 1) the 
worst case wait time for a swing buffer, and 2) the worsi case data expansion through the 



With the input data arriving at the coded data clock rate, in accordance with the present 
f invention, scdp will generate two stalls per start code (having removed three bytes from 
w the data stream). 



Input Circuit 

The input circuit of the present invention performs exactly the same way as is disclosed 
in Brolly. However, there ere a few differences of note between the two circuits. First the 
upi won't be made to wait until a valid end of s token ('cause this may never set) Instead 
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it will be made to wait until a signal in_ token is low. Second. Generation of the DATA 
header, when enterino byte mode, depends on there being some byte mode data. 

Start Codes 

In the present invention, the MPEG start codes are recognized and converted to tokens 
by the SCD. These are shown in Table 15. 



Start Code Type 


Start Code Value 


picture_start_eode 


0x00 


slice_starl_code 


0x01 to Dxaf 


reserved 


OxbO 


reserved 


Oxbi 


user_data_starl_code 


Dxb2 


sequence_start_code 


0xb3 


sequence_error_code 


OxM 


extension_siart_code 


DxbS 




0xb6 


sequence_end_code 


0xb7 


oroup_stan_code 


OxbB 



Table 15. Start Code Values 



♦ Removal of Bit Stuffing 

Any zero bits preceding a start_code_prefix are stuffing and can safely be removed, 
in the present invention, only complete bytes of stuffing are removed. 

For example. In the byte sequence shown below there are 13 stuffing bits only 6 
of which are actually removed. 

0x20 1 1 5 stuffing bits 
0x00 1 1 8 stuffing bits 
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0x00 
OxOO 

0x01 //starl_code_prefix 



Search Modes 

The BBarOwnodes. in accordance with the present invention, are described as 
follows in Table 16: 



# 



Search mode 


Operation 


0 


Normal Operation 


1 


Search (or piclure_stsn or 
higher 


2 


Search for oroup_stan or higher 


3 


Search for sequence starter 
higher 



Table 16. Starch Modes 



Any non-zero search mode causes all arriving date 10 be discarded until the desired 
class of slart code is found. At this point, the search mode is reset to 2ero, and a 
start_eode_seareh interrupt may be generated. A new control bit. 
stop_onjseanch, determines whether the SCD actually stops after generating the 
interrupt (the interrupt is also masked in the usual way, but slopping is not 
mandatory). 

£ In the present invention, search_mode is also set to Zero if the SCD receives a 
FLUSH token. However, when the FLUSH token terminates discard_all 
»eareh_rr»sta is completely reset, i.e., search.mode is reset by the combinalion 
of a FLUSH token and discard all. 



Non-aligned Start Codes 

Any run of more than one zero bytes followed by a 0x01 is a start code 
Furthermore, any run of greater than 23 zeros NOT followed by s one is s non- 
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aligned start code. In the byte aligned world, this translates lo: If, after removal of 
bit stuffing, OxOt is net received, then the start code was non-aligned. Note that 
this statement actually misses some non-aligned start codes (where less than a 
byte of stuffing was involved). 

Rather 1han going to the effort of describing in the data sheet which clBsses of non- 
aligned start codes are detected, the scdp of the present invention ignores them. 
Jn other words, stuffing is still removed. 



# 



/J -3 
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Overlapping Start Codes 

II is possible for ihe "value" part of e start code to form part of the -prefix" of a 
subsequent start code, This typically occurs tor two reasons: 1 ) the standard allows 
system level start codes to occur anywhere in the stream - including directly in the 
middle of a video level start code, and 2) errors. Removing all erroneous looking 
start codes until the lest one provides a better chance of error recovery. 

In the byte aligned environment, in accordance with the present invention. Ihe only 
way an overlapping start can happen is if a pieture_start (value = OxOD) forms part 
of another start code, In this scenario, the piclure_stsn is removed from the dale 
and the second slart code is decoded. If this. In turn, is overlapped then the same 
procedure applies until anon-overlapping slart code is detected.. 



Unrecognized Start Codes 

In the present invention, the reserved values (OxbO. 0xb1, OxbS), all system slart 
codes (OxbS.to Oxff), and the seQuence_error code (OxM) are each treated as 
unrecognized start codes. After removing the unrecognized start code, the SCD 
discards all incoming date until the next valid atari code is found. It will also sel the 
unrecognteed_start error register and, depending on' Ihe unr»cognl2ed start 
mask, will generate an interrupt. 
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Extension and User Data 
Two configuration bits are used in the present invention; 

1) Diseard_user (or not) 

2) Discard_extn (beyond MPEG2 main profile, main level) 

Both of these configuration bits are reset to ONE. 

MPEG2 extn start codes are different. The four bits following the 
extension_start_value are now an extension_start_code_identifi»r and must be 
decoded by the SCO. Four new tokens are generated to flag these. The allowed 
extension_sian_eode_idenlifiers and their respective tokens are shown in Table 17. 
However, reserved extension_start_code identifiers are not recognized. 
Unrecognized extension_stan_codes are either discarded (depending on 
Discard_extn). or replaced with the (old) extensiDn_dals token. 



# 







New Token 






Seotence Extension ID 


S=QUENCE_£XTN 


OxeB 


0010 


Sequence Displtj- Extension ID 


SeOU6NCE_DISPLAV_E)(TN 


OxeS 


0011 


dljant Matrix Extension ID 


QUANT_MA,TR|X_EXTN 




0100 








O01O 


Sequence Scalable Extension ID 














0111 


Picture Pan Scan Extension ID 






1005 


Picture Coding Extension ID 


PICTURE_CODING_EXTN 




1001 


Picture Spatial Scalable Extension ID 






1010 


Picture Temporal Scalable Extension 
ID 
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Table 17. MPEG2 extension_star1_code i _idenlifiers 



Insertion of PICTURE_END Tokens 

None of the current standards (MPEG1.2, JPEG, or H.261) specify a way of ending s 
current picture. 

However, in the present invention, the SCD 201 maintains a piece of state called 
Injaicture. This stBte is set whenever a PiCTURE_START token is output by the SCD 
201 . Any subsequent start code that is higher in the syntax than piclure_starl (or a FLUSH 
token) causes the generation of s PICTURE_END token. The PICTURE_END token is 
generated and output before any tokens associated with the new Stan code. in_picture 
is reset when the PICTURE_END token leaves the SCD 201 . If the SCD 201 receives 
tokens in the input data stream, (he action is logically identical • including receiving a 
PICTURE_END token. In summary, the start codes (and tokens) which may cause a 
PtCTURE_END to be generated, in accordance with the present invention, are: 

picture_star1_code OR token 
group_stari_code OR token 
sequence_stan_code OR token 
sequence_end_eode OR token 
FLUSH token " 



Stop After Picture Interrupt 

The stop after picture (sap) feature is of the present invention functions to facilitate e clean 
way of finishing off a current sequence, e.g., channel chBnge. it is necessary to 
accomplish this function as automatically es possible and without the need far external real 
time software. 

The sap conlrol bit is referred to as e flag_picture_end. 



fib 
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There are two control bits in addition to the flaa_picture_end. mask, end error bits: 

1) after_pieture_stop: Determines whether, after generating the interrupt the 
SCD stops. 

2) after_plcture_dlseard: Having generated a flag_picture_end interrupt this 
bit determines whether scdp automatically goes into discard_all mode. 

In this way, discard_atl mode doesn't need 10 know what event called it and ii is possible 
to leave the discard_all mode and to proceed to a search mode quickly and cleanly. 

in accordant with the invention, whenever a PICTURE_END token is output by the SCD 
the flag_plcture_end bit determines whether any action is taken. If flag_picture__end is 
set. a FLUSH is generated after the P1CTURE_END, and the event is generated 
Interrupting depends on the flag_pict U re_end_nwsk, and (having interrupted) slopping 
depends on aft.r_picture_stop. W 8 

Byway of example, for a channel change, the sequence of events is as follows: 

1) Set flag_picture_end with after_picture_stop = o and 
after_pieture_diseard = 1. 

2) Respond to flag_picture_end_event. 

a) Set search mode to sequence (for example). 
t>) Retune, etc. 

3) Either FLUSH of s/w resets discard_sll. 

4) scdp searches for the start of the next sequence. 



discard_al! 

An R/W control bit, dlscard.all, causes (he scdp of the invention to discard ail input . 
to and including a FLUSH token. This bit is automatically reset by a FLUSH token ai 
may be set by the flag_picture_end function. 
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Tokens Recognized by scdp 

While Die primary function of most of Ihe scdp of the present invention is related to actual 
token generation, there are, several tokens which when applied to the coded data port [or 
via the input circuit) are decoded 2nd acted upon by the scdp. Table 1 S illustrates and 
defines these tokens. 



Token 


Header 


Action 


Comments 


FLUSH 


0x17 


Flushes scdp 


These tokens may 


PICTURE_START 


0x12 


Sets in_pleture 


cause the generation 
of a PICTURE_END. 
In this case, they 
would resei 
in_picture andmay . 

flag_picture_end 
event ana a FLUSH 
to be generated. 


PICTURE_END 


0x16 


Resets in_picture 


GROUP_START 


0x11 




SEOUENCE.START 


0x10 




SEQUENCE.END 


0X14 




DATA 


0x04 etc. 


Dats is searched for start codes 


Other 




Unrecognized tokens are passed through 
scdp unchanged 



Table 18. Recognized Input Tokens 



Scdp Memory Map 

The various registers and their associated addresses for the scdp of ;he present invenlion 
are described in Table 19. 



Register Name 


Bits 


Reset 


Comments 


Address 


*cdp_aceess 




0 




0x0 


scdp_access 


10] 


0 


Access bit 




sedipc_cd0[7:0] 








0x1 
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Register Name 


Brts 


Reset 


Comments 


Address 


CD0[7:0) 


17:0] 




upi coded data port 




«dipc_cd1p:0] 








0x2 


coded_busy 


17] 


1 


Read Only 




enabJe_eoded 


16) 


0 






eoded_extn 


P) 




Read Only 




scdp_ctI0r7:0] 




0x30 




0x03 


diseard_extn 


15] 


1 






discardjjser 


m 


1 






disc8fd_ell 


(3) 


0 


Reset by FLUSH 




flag_picture_end 


[21 


0 


Enables event 




6fier_picture_stop 


[1] 


0 


Only if event enabled 










Only if evem enabfed 




scdp_ctl1f7:0] 




D 








[2] 




Dnly if event enabled 




sisn_cooe_searcn[2:0] 


(1:0) 


0 






Bcdp_event[7:0] 








0x5 


enci_ssafcri_evenl 


[0) 


0 






unrecognized_start_error 


ID 


0 






flag_endJof_picture_even 
1 


|0] 


0 






scdp_mask[7:0] 




' 0 




0x5 


end_search_mask 


(2) 


0 






unrecognized_start_m2sk 


[1] 


0 
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Register Name | Bits 


Reset 


Comments 


Address 


flac^endJof_picture_mask | [0) 


0 







Table 19. Parallel Start Code Detector Memory Map 



DataFlow Around the Coded Data Buffer 
The present invention provides the following advantages: 

1 ) A method of forcing the buffer to swing. 

2) A way of avoiding having to pack bytes into an odd number of bits. 

3) Reducing the width of the (potentially long) bus of the SCD down to 8 bits. 

4} The SCD does its own packaging into 32 bit data. To avoid a large bus, this 
-bit of the SCD sits inside the dramif. In the present invention, li Is referred 
to es secdbin. This module packs all DATA into 32 bit words, dead- 
reckoning in between non-DAT A takens 

5) The swing buffers do their own counting end swinging. The buffers flush in 
response lo a signal. fill_and_swing, from secdbin in response to a 
PlCTURE_END or s FLUSH token (ct signal). 

6) The unpacking module, scedbout. which sits prior to the Huffman Decoder 
deletes all data following a FLUSH or PlCTURE_END until il receives e 
buflerstart signcl provided by the output Swing buffer 
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Introduction 

This section defines the handling of time-stamp informality, in accordance with the 
present invention. 

Theory of Operation 

In MPEG-2 video and audio, dala is synchronized using information carried in the MPEG-2 
systems stream. There are essentially two types of Information that deal with 
synchronization; dock references and time-stamps. 

Clock references are used'lo inform the decoder what number is used to represent the 
time "now". This is used to initialize a counter that is incremenled at regular intervals so 
that the decoder has. ai all times, a notion ot what the current time is. 

^ Time-stamps are carried for each of the streams of dale that are used to make up the 

program (typically video and audio). In ihe case of video, a time-stamp is associated with 
a picture and it lens the decoder at what "time" {defined by Ihe counter that was initializes 
by the dock-reference) it should display the picture. 

However, es with all things In MPEG, the situation is ralher more complicated lhan this. 
There are two types of dock references; Program Clock References (PCRs) and System 
Clock References (SCRs). Clock has informalion to a resolution of SO kHz while Ihe other 
dock has additional information to extend the resolution to 27 MHZ. Clock references are 
included in the data stream fairly often in order that "time" may be reinitialized after a 
random access or channel change. 

There ere also two types of time-slamps: Presentation Time-Stamps (PTSi) and Decoder 
Time Slamps (DTSs). These only differ tor l-piclures and P-piclures which have Id be 
^ reordered (not B-pictures). The DTS tells you when 1o decode the picture, whereas ihe 
PTS tells you when to display iL In the simple case or frame pictures with no 2-3 pull-down 
effects, the difference between DTS and PTS of an I-picture or P-picture will be one more 
than the number of B-plctures that follow thai piclure frame periods. 

The important complication lo appreciate is that Ihe DTS and PTS refer lo a hypothetical 
mocel of e decoder thai can decode pictures instantly. Any real decoder cannot do this 
and must take steps 10 modify the theoretical time thai it should display pictures (defined 
by the lime-stamps and the clock references). This modification will depend on Ihe details 
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of the architecture, of the decoder. Clearly any delay introduced by the video decoder musl 
be matched by en equivalent delay in the audio decoder. 

Discontinuities 

Discontinuities in the concept "Isne" may occur. For instance, in an edited bitstream each 
edit point will have discontinuous time. A similar situation occurs at a channel change 
Care must be taken because using a time-stamp that was encoded in one time regime with 
respect to a "time" defined by a clock reference from another regime will dearly lead to 
incorrect results. 

Start-up 

A particular problem occurs at start-up (or channel change) because there are two 
potentially competing requirements for starting to decode correctly. For video 
considerations, it is now necessary to start decoding with an l-piciure that follows a system 
header (Ihis may not be true in all situations, but is largely a correct statement) but for 
system considerations the first decoded picture ought to carry s time-stamp. However, 
there is no requirement that every picture carry a time stamp and, therefore, it is possible 
lhat one may wait for ever if they try and look for a picture that is both en l-picture and 
carries a time-stamp. 

One might think oi calculating whs! the time-stamp would have been for an l-picture from 
s piaure that precedes it that does have z time-stamp. Unfortunately ihis is very difficult 
to do because it wnuld be necessary to partially decode the intervening pictures to 
determine whether they are field or frame pictures [and whether repeal firsijield is set) 
This requires that the dais go through the coded data buffer and be~discarded by the 
Huffman Decoder. 



Embodiment 



Figure 63 shows a first embodiment for implementing tirne-slamp management. The dock 
references 253 are decoded by the system demultiplex 254 of the present invention and 
placed into a counter 255. incremented at 90 kHz, that represents time. They are also 
loaded into a second copy of the counter 258 that is located inside the video decoder 270. 
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The time-stamps flow through the video buffer 271 so that they ere delayed by the same 
amount as the video data. These are then compared with the local copy of time to 
determine whether (he picture is too early or too late. 

Another embodiment, in accordance with the present invention, is shrjwn in Figure 64 
This avoids the need for the clock references 253 to be passed to the video decoder 270 
This is achieved by using a second counter "vWjime" 272. 273 which is maintained both 
in the video decoder 270 and the system decoder 25S. They ere reset at power on and 
then free run from there on. Since this embodiment requires that the two counters stay j n 
step, it is necessary to take steps to ensure they dD not get out of step. This can be 
accomplished using carry out of the counter in the system demux lo reset the one in the 
video decoder (as shown). 

Another Bdvantage of this embodiment is that there is no need tor the full 33 bits of the ' 
number to be dealt with. The ideal would be lo restricl the counters to 16 bits to allow 16 
bit handling on the video decoder 270. Although this would appear to represent an 
insufficient number range et a resolution of 90 kHz (only 2/3 second), there is no need for 
such high precision because on the video decoder, the time control is only accurate to a 
field time either way since the VTG free-runs (or is gen-locked to somethino that has 
nothing to do with the MPEG stream being decoded). 

As a result, it seems mat the lower order few bits of the time-stamp going to the decoder 
can be discarded. In the present invention, four bits are discarded. This means thai the 
video decoder uses 16 bits of a 20 bit number, The resolution is. thus. 5G25 Hz andean 
represent e time difference of 1 1 .65 seconds. 

Therefore, a Pal field is 1 12.5 ticks of the 5625 Hz dock. An NTSC field 93.84 ticks 
Hence, it is still possible to achieve liming calculations to an accuracy of about 1% of E 
field time which is adequate for the present invention. 

Hardware 

Figure 65 shows the hardware in accordance with the present invention. There are two 
modules in addition to those disclosed in Brolly. The first is added just after the start code 
detector 201 . It is responsible for generating a token. A TIME STAMP token occurs just 
before a PICTURE_START token. In the MPEG systems stream the time-stamp is carried 
in a packet header and refers lo the first piclure in the packet of data. Since the packets 
do nol line up w,th the video data there will, in generel, be the end of the previous picture 
before the start of the picture to which the time-stamp refers. 
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The time-stamp informalion may bt supplied to tie system of the present invention either 
via the rracroprocessor interface or by using a Token. In either cese. the time-stamp data 
(16 bits) is stored in a register. A flao is set to indicate the fad that valid time-stamp 
information is in the register. If the data was supplied using the TIME_STAMP token then 
that token is removed from the stream of tokens. 

Whan a PICTURE_START token is encountered, 1he flag that indicates the status of the 
register is examined. If it is dear, then no action is taken and the PICTURE_START token 
and alt subsequent data is unBffected. If, however, the flao indicates that valid time-slamp 
information is available in the register, then a TIME_STAMP token is generated before the 
PICTURE_5TART token. The flag is then deared and is available for the next time-siamp 
that occurs. 

The second hardware module is assodated with. Ihe microprogrammable State Machine 
21 6. This is simply a series of counters docked from the 27 MHz decoder clock. The first 

• is a prescaler that divides the clock by 4800 (the 4804.8 option shown in Ihe diagram is 
discussed later). 4800 is simply 300 (27 MHV90 kHz) limes 16. 

The second counter is the lima counter and is incremented each time that the prescaler 
278 output clQck. It is resel by the resetjime pin. 

The counters in this sedion should probably be implemented with fully clocked feed-back 
flip-flops (SYNC's) which are much more resistant tD a-panicle corruption lhan 1he weak- 
feedback laiches used elsewhere. (This Is because ot concern thai the time counter in 
Brian might get out of step with that in the system decoder). 

The microprogrammable Slate Machine 218 is able to read the current lime indicated by 
the tine counter and compare it with the value supplied by the TIME_STAMP token. It can 
therefore determine whether il is early or late compared lo the time at which it should be 
decoding the pictures. 

^ The registers for use in the SCD 201 relating to time stamps are shown in Table 20. 
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C 



Register name 


i 

w 


1 


Description 




B/rw 




The lower ejoht Ms ol trie time-stamp value. 

This register s stavctf to that newvalues may be written into 
this reoisterwiihout atfedno the value previously written (that 
will becoma pan 6f* TIME.STAMP token). 

Write* to this reoisler aflecl the master tesister whilst reads 
raad-beckthe slave register. UllBI a mastei-to-slave transfer 
hat been effected using is_valid, the value written into 
ts_lcw cannot be read back. 


ts.hljh 






The upper tight bits ot the Hme-stamp value. 
Slaved in the same way at tsjow. 


U.Vilid 




0 


This bil controls the masier-slave transfer of tsjow and 
W_hioh- 

When values have been wrinen into tj.low and tsjiigh tha 
microprocessor should write the value one into thit bit. It 
should then pot the bit una it rerids back the value one. At 
this point, the values written into tsjow and ts.hioh wil 
have been transferred iniothe stave registers (and can be 
read back] and ts_wartin D will be set to one. 

The microprocessor should then write Lie value rem in 
preparation lor the nsit access. 
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Register name 


Size/Dir. 


Reset Stale 


Description 






0 


When set 10 zero the roisters t,_| DW antt „_„,„„ tiD nol 
eontiin valid time-stamp Information. 








When set to on. the reolsterc tsjow end i,_hi fi h coniain 








valid Sm.-stamo Information. A T1ME_5TAMP token will be 








generated before the next PCTURE_START token end 








tj_waiting will then become ztn. 








This bh should t» polled to ensure thai it is zero before 








wrrbno a one inlo ts_ valid to ensure mat the previous time- 








stamp value has been used before it is overwritten by the 
m«st«Mo-iiave transfer. 



Table 20. Time-stamp "SCD" registers 



MSM Handling of Time-Stamp information 

This section details the function of the MSM 218. in accordance wiih the presenl invention 
when it receives the TIME_STAMP token. 

First, a 16-bit sioned time-stamp correction is added to the time-stamp thai was carried by 
the TIME_STAM? token. This correction is reset lo zero by the MSM 218 at chip-reset 
and. if no action is taken, the time-stamps are unaltered. The controlling microprocessor 
may. however, write any value into this register to modify the time-stamp and therefore 
compensate for differential delays through the video and audio decoders. 

Next, th B corrected lime-stamp is subiracted from the current time. The sign of this gives 
the direction of the error (and determines the error code, if any. generated by the MSM 
218). The absolute value of the difference is then teken and the result is compared to the 
frame time. H the result is less than the frame time, no action is taken. As previously 
discussed, time can only be controlled to an accuracy of plus or minus a frame time from 
,h„ -.eiheVTG free-runs. 
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in the present invention, K the error exceeds a tame-lime, then some correction must be 
made. The MSM 21B tan correct the situation itself if the decoding is too early since it 
can simply delay the decoding until the appropriate fime. However, if ihe decoding is later 
than the intended time, then this is more difficult because it is not possible to discard 
pictures reliably at the output of the coded dala buffer. Essentially, me decoding of the 
sequence is broker and the most reliable way to correct the situation is to restart the 
decoding process in a manner similar 10 random-access or channel change. In order to 
facilitate this procedure, the control register or the MSM 218 may be programmed to 
discard all data until a FLUSH token is encountered. 



• 



If the MSM 218, in accordance with the presenl invenlion, receives a time-stamp at a time 
which K recognizes as a start-up situation {e.g., after reset, following a SEQUENCE END 
token or FLUSH token and It is still Defore tne first PICTURE.START) then the action of 
the MSM 218 may be modified. If the time-stamp indicates that decoding should have 
occurred earlier than the current lime, then the situation is handled in the same way as 
detailed above. However, if the time-stamp indicates that the decoding still remains to 
lake place after the current lime (which is the normal situation on start-up), then ihe 
decoder will wait until the correct lime even if the error is less than one frame-time. In this 
way. H is possible to set the nominal decoding time as accurately as possible to the correct 
lime. Subsequenl pictures may then Be decoded. Up to one frame-time before or after their 
nominal lime, without any error situation being triggered. 

In addition, in the present invenlion the error "ERR_TOO_EARLY" is not generated during 
starl-up (since it is expected thai decoding would be early) irrespective of the setting D f 



As a result of the time-stamp handling, il is possible that one of two errors will be 
generated. 

ERR_TO0_EARLY is generated if the decoding it taking place earlier than the time 
indicated by the time-stamp. 



ERR_TOO_LATE is generated if the decoding is taking place later than the time indicated 
by the time- stamp. 
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ERR_TOO_EARLY may be suppressed, but £RR_TOO_LATE will always be 
unless all errors are masked out. 



Table 21 describes the various time-stamp reoisters associated with 
Microproorammable State Machine, in accordance with the present invention. 







1 




Register name 


9 
S 
S3 


a 


Description 


ti correction 


ISVrw 




Correction added lo each lime-stamp before i Is us*. 




16/rw 


22S or 


Represents me tolerance on the tMne of decoding pieces. 
Reset slate determined by the PAUNTSC pin. 


time 


1&ro 




Reset by either reset or time r*t»« Tk. , 

' ™ "nn_reset. the current value of bme. 


manual_startup 






When set to on,, the startup is to be performed manually using 
dtcode_disable. In this case. EEQUENCE_ENO and FLUSH 
tokens at me MSM cause decode_disabl« to be set to one, 

When sei to 2ero. startup is p,rfarmed using trie time-stamp 
management hardware. Decode-disable is new automatically 
set to one. 


deccde_disabl« 


1/rw 




When set to jero. the decoding proceeds normally. 








At me stan ol each picture, the MSM checks ma status o! 
deeode_disable and will not proceed il K s set to one. 








Note that if manual start-up is to be performed (i.e., without the 
eme^amp management hardware) this bit should bi set to one 
al the same time bs manual-startup is sal to one. 


dis»t>le_lco_earty 






When set to one. me error "£RR_TOO_EAJ?LY* indicating that 
me decoding is too earty is suppressed and the MSM simply wis 
to correct the situation. 


NT5C_10 




When sel to one, me prescaler divides by 460<.B rather than 
<S00. 5e: automatically when decoding 30 Hz frame rates 



/3 S 
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r 






Register name 


i 

as 


fT 


Description 


tfis«rd_ltj»tt 


1/rvf 




This has no effect unless an "ERR_TOD_LATE" is generated (or 
would be generated if errors were not m«ked out). If it is set lo 
on* then data it discarded until the condition indicated by 
d»e»rd_iiniil. 


<lKMrd_Lntll 


ZAW 


0 


indicate the condition which causes time-atemp triggered 
discarding, io b» terminated. 

0 - FLUSH 

1 - SEOUENCE_S7ART 

2 - GROUP.START 
3-NeM Piciuie. 

Note 1- that discarding on. picture may immediately be un-done 
If thai picture is a 6elc picture by the generation of » dummy field 
to preserve the alternating top/bottom field structure. As . result 
If tftscard. until is set lo "Nen Picture ■ but the dummy field would 
be generated on* further picture is discarded. 



Table 21. Time-stamp "MSM" registers 



SLiPPPfl fry 3Q._Hj: 

The present invention does not support a 30 Hz frame rate properly. However, it will be 
appreciated by one of ordinary skill in the art, thai the invention may decode 30 Hz data 
if the clock generation circuitry is modified appropriately. In this esse trie system is 
clocked with a 27.027 MHz clock so that the typical -CCIR-601 ■ raster produces pictures 
at precisely 30 Hz. In order lo accommodate the 27.027 MHz clock, it must be divided by 
300.3 to provide the 90 kHz clock. Since the present invention scales this value by a 
factor of sixteen, it is necessary lo divide the clock by 4B0A.6. 



#M¥8-1 7 26 24 



Introduction 

This section details a Miero-codeable Slate Machine (MSM). in accordance with the 
present invention. The aim of building the MSM was i 0 produce a machine that with small 
amendments can be used in a number of applications such as a VLC decoder and address 
Generators. 

The MSM of Ihe present invention is of a general purpose nature providing support to a 
wide range of features. However, the underlying structure of the MSM is modular alfowino 
flexibility in building. Accordingly, those of ordinary skill in the art will appreciate that the 
present invention can be used with a variety of applications. 

As shown in Figure 66. the system design is segmented into two sections The first is a 
Slate Machine 21B. This generates instructions th a , are passed to a dats , process no 

♦ PVelim under the control of a two-wire interface as previously disclosed in the Brolly 
appl.cation and incorporated by reference herein. The second section is an Arithmetic 
2lTifirfo?^ 

219 is part of the data processing ptpehne. It accepts data and instructions under the 
control of two 2-wire interfaces. 1 It generates data at its output under the control of a two- 
wire interface. Bringing these two components together allows the definition of the 
complete ucode word. " ' 

State Machine 

^,L S l a It Ma , Ct T 21 , 8, " accordan " w ' th ,he P r «ent invention, provides instructions 
^^S^!!' " 8,50 Pr ° VirfeS in5iriJC,i ° nS ,0 C ° rtr0! i!S6!f ' n ** ^ r « Si °" 

- The address of the instruction being passed lo the Arithmetic Core 21 9 is held in the 

the address. However, "jump" or "call- instructions and/or "interrupt/error' events L 
cause the Program Counter to reioad. hence altering the order of instruction executioT 



!L!Trf a ^ ISle M l Chine iS 3lS0 CDntro,liR S upst'esm blocks, these two 2-wire 
interfaces may be combined. 
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The Stale Machine 218 allows for up to 4096 instructions in the present invention 
However, H will be appreciated by those skilled in the an thai other amounts of instructions 
may also be used and this is not intended to act as a limitation. 

Jumps and Calls 

In this implementation, all instructions are conditional jump instructions. A condition is 
evaluated for every instruction to determine whether or noi to jump (i.e., reload the 
Program Counter). The two conditions "True" and "False" are provided to unconditionally 
jump or not jump respectively. The remainder of the conditions (sixteen in total) are based 
on tests on the Status bus. If the condilion is nol -true 11 or "false," the State Machine 218 
will wait until the Arithmetic Core 219 has executed the instruction and fed the status bus 
tack to the Slate Machine for testing against the condition. These conditions are shown 
belo in Table 22. 



Code 


Condition 




0001 


F 


False • never jump 


0010 


C 


Carry set 


0011 


NC 


Carry clear 


0100 


2 


Zero 


0101 


NZ 


Non-zero 


0110 




ALU result Negative 


0111 


AP 


ALU result Positive 


1000 


F 


False - spare conditions 


1001 


F 




1010 


LT 


(S"V) fl-J indicates KJ) 


1011 


GE 


-(S-V) [l-J indicates I J] 


1100 ! 




An index Register Incr. stepped past terminal 


1101 


Nl 


An index Register Incr. Sid not step past 
terminal 



'V 1 
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TABLE 22. State Machlns conditions 



If a jump is taken on an instruction wilh the call bit set, the next address, had the jump not 
been taken, will be stored as the return address. Accordingly, this forms a mechanism for 
routine calling. To return from the routine to Ihe stored address, a call is made to address 
0x001. Calling is only supported to a depth of one call, i.e., only one return address can 
be stored. Nevertheless, calling from calls, although erroneous, is no! checked for in the 
hardware. 



Interrupts and Errors 

In the present invention, if the interrupt/error wire sampled high, an unconditional jump is 
made to the interrupt/error address (address 0x001). The next address that was id have 
been taken without the interrupt/error is stored. To return from the interrupt/error routine, 
is a jump to Ihe interrupt address (0x001) is performed. 

The State Machine 218, in accordance with (he present invention, is hardwired lo execute 
as either an interrupt or error routine. The difference is that interrupt routines m2sk out 
other interrupts while executing, whereas error routines do not. The Stale Machine 21 8 
is currently wired as an interrupt rather than an error pin. 

Jump Addresses 



The address loaded inlo the Program Counter is Ihe Jump address. The twelve bits rjf this 
address are contained in a ucode field. It can either be an absolute address or it may 
0 have portions substituted inlo it from the output ol the ALU 222. If an address is to be 
substituted, the State Machine 21 8 will wait until trie Arithmetic Core 21 9 has executed ihe 
instruction and fed the ALU 222 output to the State Machine for the substitution. 

The format of the address, in accordance with the present invention, is shown in Table 23, 
"Jump Address substitution". The bits marked "a" indicate absolute address bits. The 
remaining address bits of lesser significance will be substituted. The LSB marked "s" is 
the substitute bit. 
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Mo. Bits 
Replaced 


B 


A 


I 9 

1 


e 


7 


6 


|i 


A 


3 


2 


1 


0 


B 


0 




3 




a 


a 


a 


s 


8 


3 


a 


a 


a 


0 


1 


a 


a 


a 


a 


s 


2 


a 


a 


s 


a 


■ 


0 




2 


a 


3 


a 


a 


8 


s 


a 


a 


a 


a 


0 






3 


2 


a 


a 


3 


a 


2 


s 


3 


a 


0 








4 


S 


a 


a 


B 




a 


a 


E 


0 










5 




a 


a 




s 






0 












6 














0 














7 












0 










1 






8 






a 




D 


















9 


3 




a 


0 


1 












1 






10 






0 


1 




















11 




0 


















i 






12 


D 




1 
















1 






Load Return 
Addr. } 


1 


1 


1 


1 


1 






1 













Table 23. Jump Address substitution 
The address substitution feature of the present invention ellows the construction of jump 



State Machine Internal Instructions 

It may be desired to perform repeated conditional tests on the status bus These 
instruct.ons are internal to the State Machine 218 and require stable feedback from the ' 
Arithmetic Core 219. Therefore, these type ot instructions can be marked as non-valid for 
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the Arithmetic Core 219, which will then (ail to execute them. Accordingly, a "valid" bit is 
provided to mark instructions as valid -for the Arithmetic Core 219. 

State Machine Testing 

In the present invention to enable the Slate Machine's 21 B operation to be verified a 
number of registers will be accessible to the microprocessor bus. Access may be gained 
by setting the "access- register to one and then polling the register until it reads back this 
value. The State Machine is then halted and it is safe to access. The machine can be 
. restarted by writing zero lo the "access" register. 

When the microprocessor has access, it can read and write to the following registers: 

the program counter 

the call return address 

the interrupt return address 

Jhe interrupt status bit (i.e., staling whether a interrupt is in progress) 
all bits of the ucode 
Table 24 describes the various addresses of these registers. 

The Slate Machine 218 can also stop itself by generating e microprocessor event Only 
if the event's mask bit is set will the machine halt. Access should then be gained in the 
normal way when servicing this event An event can be brought about by a call to the 
reset address (0x00). The call will not actually be taken, but simply generate the eveni 
after the instruction is executed. It will, nevertheless, remain at the output of the 
Instruction ROM for inspection. 

The State Machine 21 6 of the presenl invention possess s mode in which it will sinole step 
through Hs instructions. Single stepping is initiated by setting bit 0 of the MSSR register 
The machine will then stop before each instruction. The stopped state is indicated by 
= Stopped. The instruction about to be executed will then be at the oulput of the 
instruction ROM and is able to be changed via microprocessor access. To restart the 
machine, write "1" to bit 1 of the MSSR register. Both of these bit registers are 
synchronized and. therefore, require microprocessor access before they can be accessed 
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State Machine Ucode Map 

Table 25 Shows the microcode map for the Stale machine of the present invenlion. 



Address 


Use 


OxOOO 


reset address 


0x001 


interrupt/error address 


0x002 
-Oxfff 


ucode program 
addresses 



Table 25. State Machine Ucode Map 
State Machine ucode word 

Similarly. Table 26 depicts the Slate machine microcode word, in accordance with the 
present invenlion. 



iBituse |,| a } a | a | B |«{, |. [ e | a | a | a H c j Condition (v| 
Table 26. State Machine Ucode Word 

where: 

e = address: 

s = substitute an address; 
c = call or jump; 

condition = jump condition code; and 
v = instruction valid for Arithmetic Core 
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Arithmetic Core 

In the present invention, the Arithmetic Core 21 9 performs all the data manipulation within 
the MSM 218. As shown in Figure 67, the general structure of lhB Arithmetic Core 219 
includes functional blocks which select their inputs tram the available buses and provide 
a bus as output. 

The Arithmetic Core 219 is 32 bits wide, and is built from bit-slices which allows B, 1 6. 24 
or 32 bit data paths to be constructed in other implementations. 

As depicted in Figure 68, the Arithmetic Core 219 of the invention has three main 
functional blocks: the token port 360, (or communicating with the data stream; the ALU 222 
(and possibly other functions) for executing computations; and the Register File 221 which 
contains all the registers. All output buses are labeled in Figure 66. Inputs to blocks are 
selected from these buses. The size of these selectors and their inputs can vary and are 
under ticode control. 



The ALU Week 222, in accordance with the present invention, is responsible for all the 
computations and number manipulations in the erithmelic core. It allows quite complicated 
computations (such as recirculating, multiplication and division) to be performed by a 
combination of relatively simply operations (i.e., shifting, conditional inversion and 
addition). Each of these blocks is described below. Examples are then provided es lo how 
these may be used in the Arithmetic Core 219. 85 a whole, to perform the more 



In me present invention, the "shift" block allows for s 1 til left shirt, a right shift, or no shift. 
0 The 1 bit bus K is rotated into the woid as if il were an extra bit. This is shown in Table 
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ss 


shift function 


11 


r = [l >;>1) + (K«32) 



Table 27. Shift Block 



Ifss=0b01 a "NOP" is signaled to the ALU 222 as a whole. This is a Nd Operation si 
will prevent any status flags begin altered from the last operation. 



The Carry block eHhtir takes the carry bit from status registers or clears it. In single word 
addition and subtraction operations, the carry bit wiB be cleared, while in multiple word 
operations, the carry generated by the previous operation (and stored in the status flags) 
will be used as the carry. This is depicted in Table 26. 





carry function 


0 


C = 0 




C = H from status flao 



Table 28. Carry Block 



10 
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invert function 


11 


J' = (L 7 J:- J) 
C' = (L?C:-C} 



Table 29. Condition Block 



al U Core 

The ALU core 222 ol the present invention performs a simple set ot logic and arithmetic 
functions using two's complement arithmetic These are defined in Table 3D. 



ft 




0 


r ♦ j' + c 


Add 


1 


r * J' 


XOR 


10 


i' & J' 


AND 


11 


I'M' 


OR 



Table 30. ALU Core ' 



From the resuH of Ihe ALU core 222, four staius Hags are generated. (See Table 31.) 
These are both stored in the Register File 221 (as shown in Table 36) end are sent beck 
to the State Macru'n* 21Bfor comparison with condition codes. 



• 



Meaning 


invert function 


Carry 


Carry Out from ALU operation 


Zero 


ALU result is zero 


Negative 


MSB of ALU result » 1 


Overflow 


ALU operation overflows 



Table 31, Status Flags generated by the ALU core 
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ALUUCOdeWnrrt 

Table 32 illustrates Ihe ALU microcode word. 

Bit use s s I I [f 1 e 

Table 32. ALU microcode word 

where 

ss is the shift block controls 
il is the condition block controls 
ff is the ALU core controls 
c is ihe carry block controls 

Table 33 describes the bits patterns for the various functions of the ALU, in accordance 
with the present invention. 



Bit number 


bU 


4 


3 


2 






Addition (l+J) 


0 


0 


0 


0 


0 


0 


0 


Subtraction (l-J) 


0 


0 


0 




0 


0 


0 


Multiplication 


1 


0 


1 


0 


D 


0 


0 


Division 


1 


0 


1 


1 


0 


0 


0 



Table 33. 

Register File 

Figure 69 illustrates the register file 221 of the present invention. The register file 221 
contains 54 thirty-two bit word registers. The register file 221 can address partial words 
i.e., the file can be addressed as 64 x 32 bit. 12B x 16 bit, 256 x 8 bit. 512 x A bit, 1D2< x 
2 bit. or 2048 x 1 bit formats. The address is provided directly Irom the ucode or the 
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address may hay© portions of i1 substituted into from special registers. This allows 
indexed access of the register. 

At each instruction, a read-modrfy-write will be done on a single register. The read-modify, 
write facilitates the writing of partial words back into the file. The source of the write is 
determined by an external multiplexer with its own independent ueode. If no write is 
desired, the output of the register file 221 should be selected by the multiplexer. 

Partial words will be treated as signed or unsigned numbers dependent on bit 0 of ihe 
mode register. If the partial word is negative (i.e., it has its MSB set) it will be sign 
extended up the full width of the bus. This allows the easy use of partial words in 
arithmetic. 

Three locations in the register file 221 of the present invention are also connected to a 

dedicated bus, but they are still allowed to be used in parallel with other register file 
^ locations. These are the A and B registers and the status register shown in Figure 65. 
W The register file also contains the index registers for address substitution with 

accompanying terminal count, registers, constant registers and a mode register specifying 

modes of the register fife. 

Register File Addressing 

The addressing, in accordance with the present invention, must cope with two different 
features: variable length addresses for accessing varying width portions or words, and 
address substitution. 

To address partial words requires a longer address. Therefore, all addresses are of 
variable length and they are encoded as follows: where "a" is an address bit, the least 
significanl of the address bits is "S", the substitution bit. 
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Data Width 


B 


A 


9 


8 


7 


5 


5 


4 


3 


2 


1 


0 


S 






3 


a 


3 


s 








8 




a 


a 


a 


2 


0 






S 






3 


a 


a 


s 




s 


a 




0 


0 


1 








e 






E 


s 




& 


£ 


0 


0 


0 


1 






s 












s 


16 


0 


0 


0 


a 


l 






8 


5 


S 


a 


2 




32 <24) 


0 


0 


0 


0 


0 


1 


2 


a 


a 


a 


a 


a 


a 



TABLE 34. Variable width addressing 



The addressing is big endien. That is to say the higher, more significant portions of the 
words are addressed with lower addresses. 

Portions of the addresses "z...sT can be substituted with one of the index registers. Using 
an address of an eight bit word as defined in Table 34 as an example, Table 35 shows how 
to define the number of least significant bits which are to be substituted. All trailing zeros 
are substituted. 
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Bite to bi substituted 



0 0 1 b 0 1 



TABLE 35. Address substitution 



For example, substituting A bits into s thirty-two bil address would have the form 
0bO00O01aaa01 1 1 1 or substituting zero bits into e one bit address Obi aaaaaaaaaaaaO. 

In the invention, the substitution will come from one of the two eight bit index registers, 
which is specified in the register files ucode word. I! can. therefore, be seen that a 
maximum of eight bits can be substituted into an address. 

It can also be seen that with the above scheme, it is possible to use illegal addresses, 
such as ObOOOOOO 0000000 or Obi 111 1 1111 1 1 1 1 1. Illegal addresses will result in no 
address being accessed, leaving the output bus of the register file unknown, 

Rosier Fit? Register i VQS1 

In the present invention, there are a plurality of register file register types. Each is 
described as follows: 



« Independently bused registers 

Three registers (A, B, and Status register) have their own dedicated buses, as well as 
being accessible in the normal way in the register file. This allows the registers 10 be 
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connected to more places in the arithmetic core 219 and to be accessible in parallel to 
others in the register file. The independent buses can only access the registers in their 
full width, i.e., 32 bits wide. 

"There is no ucode write enable lo these registers. Writing to them is only by way 0 f an 
external multiplexer which has hs own ucode control word. To prevent a write, they must 
be written to with their own value as shown in Figure 70. 

When the independent bus registers are written to as it in the register file, the independent 
but write Is suppressed. 



The Status register is implemented as an independent bus register. The bits of the 
register are defined in Table 36. 



Bit 






Comment 


0 




Index Reg 


An index register increments passed its terrr 


inal count 


1 


E 


Extn 


Extension bit from input 


2 


V 


Overflow 


ALU operation overflows 


3 


N 


Negative 


MSB of ALU result* 1 






Z 


Zero 


ALU result is zero 


5 


c 


Carry 


Carry from ALU operation 


6 j 




Gnd 


Unused 




7 




Gnd 


Unused 



TABLE 36. Definition of the Status register 



• Index and terminal count registers • 

Two eight bit Index registers are provided for substituting into addresses. One of these 
can be incremented per instruction under the control of the ucode. Furthermore, each is 
accompanied by a terminal count register. When the register incremented is passed its 
terminal count will be reset to zero. 
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The index registers are called Y and Z which have terminal counl registers U and V, 
respectively. All of these can bo accessed in tne register file. 

Index register Z has a predefined decoder attached to Us output (at present this decode 
is an inversion). Dependent on Ihe lndex_Mode in the mode register (bit 1), this decoder 
rather than the index registers, will be used in address substitution and read from Z in the 
register file. <lndex_Mode = 1 read decode. lndex_Mode = 0 read count) 

Constant registers 

In the present invention, sixteen ot the register Tie's 32 bit locations will be predefined 
constants. These may be read out as normal registers Writing to these locaiions will 
have no effect. (The constants selected for the current embodiment are 0-7. However, it 
will be appreciated that other numbers of constants may be used.) 

This Implementation of constants in accordance with the present invention, does away with 
the need for e constant field in the ucode and for a constant bus in the arithmetic core. It 
does, however, limit the number of constants useable in the program (The number 16 is 
negotiable.) These constants are programmed on s per instance basis. Furthermore, very 
frequently used values could be connected to multiplexers, if necessary. 

Register Pile Address Map 

Table 37 shows the Register File address map for the present invention. 



32 Bit Location 


BUS 


j^eoister 


0x00 




A regis I er 


0x01 


All 


B register 


0x02 


7:0 


Status register 


0x02 


e 


Sign Extend mode 


0x02 


9 


Index Decode mode 


0x02 


31:10 


NormEl register 


0x03 


7:0 


Y index register 


0x03 


15:8 


Z index register 
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32 Bit Location 


Bits 


Reoister 


0x03 


31:16 


Normal register 


0x04 


7:0 


U terminal count register 


0x04 


15:6 


V terminal CDmt register 


OxCM 


31:16 


Normal register 


OXO5-0X37 


All 


Normal registers 


Ox37-0x3F 


All 


Constants 



TABLE 37. Register File Address Map 



Register Fil<? Vcpde Word 

Table 36 shows the Register File microcode word for the present invention. 

Bit d C b a 9 8 7 6 £ I 4 I 3 2 j 1 I 0 1 
No. II I I | 

Bit use s ea a a a a a a a | e s r 1 I j 
Table 38. Register File Ucode Word 

a = whole register file address (always 12 bits) 
s = substitute bit 

r = index regis;er to use for substitution: select Y, Z index registers if n 

= 0, 1 respectively 
I = increment index register specified by r 

Token Port 

The Token Port of the present invention is the arithmetic core's connection to the dais 
stream. It is a two-wire interface connection. 
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The data at the Token Port input is only defined during a Token Pon reading cycle, tt 
should, therefore, be used during read cycles only. 

If the input port does not contain valid dais during a read cycle or the outpu! port is not 
accepting during a write cycle, the Arithmetic Core will stall. Accordingly, it will perform 
no operation, read no new ucode word, and wrile no registers. It will only restart when 
these conditions do not exist. 

T^PnrMlrnrie Word 

Table 39 depicts the Token Port microcode word. 



Bit No. I 1 6 

Bil use | I 0 



Table 38. Token Pon Ucode Word 
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where 

I = read inlo input port 
0 = write from output port 

Multiplexers 

The selection of sources for blocks is done by the use of multiplexers. Almost all 
combinations of bus ere ellowed (with the exception thai the Input to functional blocks, 
e.g., the ALU must be from storage blocks, e.O., Token Port or Register File). 

The multiplexers are either 2, A or 8 input. They, therefore, use 1 , 2, or 3 bits of ucode 
word, respectively, to control their selection of inputs. 

UP! Memory Map 

Table 40 shows the MSM address map, in accordance with the present invention. 





Bits 


Location 


0x000 


0 


MSM Event bit 


0x001 


0 


MSM Mask bit 


0x100 


7 


Access bil 


0x101 


0 


MSSR Set single slepping 


0x101 




MSSR Monitor Single Stepping 


0x101 


2 


MSSR Interrupt status register (Read Only) 


0x102 


3:0 


Program Counter MSB 


0x103 


7:0 


Program Counter LSB 


0x1 OA 


3:0 


Call Return Address MSB 


0x105 


7:0 


Call Return Address LSB 


0x106 


3.0 


Interrupt Return Address 


0x107 


7:0 | Inlerrupl Return Address 
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Address 


Bits. 


Loestion 


0x200- 


7:0 


Register File 


0x2ff 







Table 40. MSM Address Map 



• 



• 
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Introduction 

In the MPEG coding standards (both EGMP-1 and MPEG-2) the quantized coefficients are 
coded as "events". Each event is coded as a RUN and a LEVEL. The RUN is the number 
of zero coefficients that precede a given nonzero coefficient. The LEVEL is the value of 
that coefficient. In addition, one special event. End-of-block. is used afler the last non- 
zero coefficient to indicate that the remainder of the block is all-zeros. 

For example, assume the following sequence of coefficients: 

1, -7, 0. 3, 0. 0, 0, -1, 0, 0. 0, 0, ...0 (total Df 64 coefficients) 
These would be modeled by the following events represented as (RUN, LEVEL): 

(AD (0,-7) (1,3) (3, -1){EOB) 

It is the task df the inverse modeler to reverse the modeling process such that each of the 
64 coefficients is represented as a simple number for subsequent processing 



Interfaces 

The following signal pins are used to transfer eata into the inverse modeler of the present 
invention: 

• level [11.-0] 
■ run(5;0] 

• In_extn 

• in_valid 

• in_accept 

Tokens are transferred on the leve![11:0] bu 5 -(in the lower order eight bits; leveirj^j). 

run[5:0] serves as an auxiliary bus to carry the RUN information. 11 has no meaning 
except in the data words of a DATA token. 

The following signals are used at the output of the inverse modeler: 

• out_data[ll:0] 
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out_va!id 
out_aeeept 



Functional Description 

Data in DATA tokens is expanded so Ihai mere is always 64 coefficient in the DATA 
token presented at the output of the inverse modeller. In most ceses, the las) data word 
of the DATA token will not cause the B4 r coefficient to be generated. This is not an error, 
it is just that at this point the EOB event would have been coded in the bitstream. 
Therefore, in this situation the inverse modeller musl continue io output zero data token 
words until a total of 64 coefficients have been produced at the output. 

In certain circumstances (e.g., when a dala error occurs) it is possible for the DATA loken 
at the input to the inverse modeller lo represent more Than 64 coefficients. In this 
situation, the modeller musl discard all the extra dale and produce a loken a! lis output that 
conlains just 64 coefficients. 

All non-DAT-A tokens that appear a! the input are simply trensferred, unmodified to the 
output of the inverse modeller. 



Timing Requirements 

II is a requirement of the present invention thai data flow through the inverse modeller si 
the clock rale. 

In the situation where there are nc gaps ai Ihe input 10 !he Imodel and the circuity 
connected to the output does not cause the Imodel to stall (i.e., invalid = 1, out accept 
Q =1) then e new data word will appear a! the output of the Imodel every clock cycle. Note 
however, that in this situation, ihe Imodel mey not accept new data at its input on every 
Single clock cycle because a non-zero RUN (in a DATA loken) will cause more than one 
data word to be produced for each input. 



'6.0 
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Microprocessor Interface Access 

The inverse modeller circuitry of the present invention is not required lo be connected id 
the MPI in its normal mode of operation. Note thst the error condition (too many 
coefficients) should not produce a microprocessor interrupt, It is simply dealt with 
internally by discarding the extra data. 

However, microprocessor access will be required for the snooper (lest) circuitry at the 
input of the block. 
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Introduction 

In fhe MPEG coding standards, the coefficients are "zig-zag" scanned so thai the icwer 
frequency coefficients are transmitted before the higher frequency coefficients. 

It is the function of the inverse ig-zag, in accordance with the present invention, to convert 
the one-dimensional stream of coefficients it receives from the inverse modeller into a two- 
dimensional array of coefficients that can be processed by the 1DCT. 

In MPEG-1 . only one scan path was used, this was literally e zig-zag (hence, the name) 
MPEG-2, however, uses two scan paths. The first is the original MPEG-1 path, the second 
Is optimized for use in interlaced coding where there tends to be unusually large vertical 
frequency component. 

£ In addition to the coefficients which are obviously transmitted in 2ig-2Bg scan order, the 
quantization matrices are downloaded in zig-zag scan order as well. This occurs in 
MPEG-1. H.261 and JPEG. As a result, the present invention has its quantizer before the 
inverse zig-zag (which was implemented as peri of the IDCT). The quantizer, therefore, 
operates on e one-dimensional stream of coefficients which arrive in the same order as the 
downloaded quantization matrix coefficients. Hence, the quantizer simply has to associate 
the first coefficient with the first matrix element, the second coefficient with the second 
matrix element, and so forth. 

However, since there are now two scan paths in MPEG-2, a new approach was taken on 
the present invention in which the inverse zig-zag precedes the inverse quantizer. Both 
the coefficients and the downloaded matrices are inverse scanned and the inverse 
quantizer now operates on the two dimensional data. It should be noted thai this is only 
possible because in all three representations of the dais (two zig-zag scans and the raster- 

• scan order at the output of tne 122) the first coefficient is always first and the last 
coefficient is always last. The first coefficient is specially treaied in the Iquant because it 
is the DC term. The last coefficient is specially treated because it may need tD be modified 
as a result of mis-match control as a function of the values or all the other coefficients (so 
it must be last!}. The 62 remaining coefficients are all handled in the same manner 
(excepting that each has its own quantization matrix element). 



Interfaces 



The following signals are used at the input cf the inverse zig-zag of the invention: 
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• in_data[11:0J 

• in_extn 

• in-valid 

• in-accept 

The following signals are used at the output of trie inverse 2ig-zag: 



■ out_data[11:o] 

• out_txtn 

• in_v«lid 

• out_aceept 



Functional Description 
The IZ2 responds to the following tokens: 

• PICTURE_START 

• ALTERNATE.SCAN 
« DATA 

• QUANT.TABLE 



All other tokens are passed, unmodified, through the IZZ. 

The P1CTURE_START token causes the 122 to reset Its internal state which represents 
which of the two scan paths is in force {e.g., alternate scan) id zero findicalino the 
MPEG-1 scan). " y 



ALTERNATE_SCAN is e token which can be allocated the value OxeS with e mask Oxfe 
The ALTERNATE_SCAN token is shown in Table 41. 



Table 41. Wtemate_Scan Token 

''S" is the indication of which scan to use tor subsequent DATA tokens and is therefore 
loaded into the IZZ register "alternate_scan". 



'*3 
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DATA tokens are re-ordered according Id scan path zero (the MPEG-i scan path) 
irrespective of the setting of alterrwte^scan Note that alternate_sean must retain 
whatever value it had (i.e., must rot be set to aero) so that subsequent DATA tokens are 
correctly handled, 

QUANTJTABLE tokens are re-ordered according to scan path zero (the MPEG-1 scan 
path) irrespective of the setting of alternate_sean. Note that alternates can must retain 
whatever value H had (i.e.. it must not be set to zero) so that subsequent DATA tokens are 
correctly handled. 

Mal-formed Tokens 

Both the DATA and QUANT_TABLE tokens may be rnal-formed. Clearly, the DATA token 
should be correct since the Imodel should have ensured that it is correctly formed. 
However, no such assurance is available for Qu*ANT_TABLE. Since handling the mal- 
formed QUANT_TABL£ tokens must be implemented, it should also be implemented for 
DATA tokens as welt. 

In accordance with the present invention, DATA and QUANT_TABLE tokens are too short 
when they appear at the input to me IZZ should result in a token el the output with the 
correct number (64) of data words. The data contained in those words is unimportant and 
will probably be whatever junk happened to be in the re-ordering RAM before the start of 
the token. Similarly, DATA and QUANT_TABLE tokens that are too long should also 
result in correctly formed tokens at the output. The first BA coefficients (matrix elemenls) 
should be used, the remainder should be discarded. 

Following a mal-formetJ token, all subsequent (correctly formed) tokens should be handled 
properly. 

There is no requirement for a microprocessor interface error (interrupt) to be generated. 
Raster Scan Order 

At the output of the IZZ, the DATA and QUANT_TABLE tokens of the present invention 
represent two-dimensional data. However, the coefficients are still actually transferred as 
a one-dimensional series of numbers. The question Brises whether the data should be 
transferred as rows or as columns. 
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The prediction circuitry will require the pel-domain Oats to be organized in rasler-scan 
order. Since the IDCT transposes tne data it follows thai the data ooing into the IDCT 
must be the other way around. Table 42 illustrates the order of the coefficients transferred 
at the output of the 122 for DATA and QUANTJABLE tokens. 

increasing horizontal frequency - u 



Table 42. IZZ Output Coefficients 



Microprocessor interface Access 

There is no requirement lor microprocessor access in the normj.l functioning of the 122 
However, access win probably be required so that the reordering RAM can be tested. It 
' is also expected that there will be no requirement for a snooper. The one at the start of 
the Imodel is sufficient for both blocks. 
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This section deal with predictions. In this introductory section, all possible prediction 
modes are enumerated and diagrams are provided tor each one lo explain exactly what 
must be done. 

Throughout this section no special attention is given to operations, such as halt-pel 
filtering, that occur in the horizontal dimension This is because these operations are the 
same as those on Brolly In the vertical dimension, however, things are very different 
because of the interlaced picture format. 

Prediction In Frame Pictures 

frame-based Prediction 

In this mode, a prediction is formed from e reference frame. The result is as if th B two 
reference fields were first combined into e frame and then a prediction were made from 
that frame. Note that this is precisely the situation as described in Brolly. 

Half-pel filtering may be made in the vertical direction and this is triooered by the least 
significant bit of the vector. In addition to the least significant bit, the next most significant 
bit (bit 1) has special significance since (his will determine whether the top line of the 
prediction comes from the top reference field or the bottom reference field. 

Thus, four cases have to be considered, each dependant upon the binary value of the 
least significant two bits of the vertical vector 

i*ctarft] = 0, vee/o<f.O]» 0 

As shown in Figure 71 , just 16 lines (8 for the chroma) are read (since there is no hall pel 
filtering. 8(1) lines from each reference field. 

vecror[1] = n, vecfcrfO) = 1 

Likewise, as shown in Figure 72, 17(9) lines are reed. 9(5) lines are read from the top 
reference-field, 8(4) lines from the botlom reference field. 

vec(ort1]= 1. vecloriO} = 0 
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Again, as shown in Fijjure 73. just 16(B) lines are read but note thai now the top line of the 
prediction has been read from the bottom reference field. 

verto/t1]=1,v*tforJ0] = i 

And, Figure 74 shows 17(9) lines are read, B{4) lines are read from the top reference field 
9(5) lines from the bottom reference field. 

Accordingly, bit 1 indicates which reference field holds the top-most line that must be read 
to produce the prediction. In addition, if bit 0 is also set. ii Indicates which reference field 
has the extra line to enable half-pel Tillering to be performed. 

It Is clear that harf-pel prediction cannot be performed until both fields have been read from 



Great care must also be taken when scaling vertical motion vectors to obtain offsets in the 
field sfore. The following table. Table 43, illustrates the effect: 







Offset in field 


Vector 


Bit pettern 


top field 


bottom field 


•2 


...1110D' 


...11110{-Z) 


...1111 (-2) 


-1.5 


...11101 


...11111 (-1) 


...11110(-2) 


. -1 


...11110 


...1111 (-1) 


...11111 (-1) 


-0.5 


...11111 


...0Q00O (D( 


...11111 (-1) 


0 


. ..00000 


. -.00000(0) 


...00000(0) 


0.5 


...00001 


...0OO01 (1) 


...DOOOO(O) 


1 


...00010 


...00001 (1) 


...00001 (1) 


1.5 


...00011 


...00010(2) 


...00001 (1) 


2 


...00100 


...D0D10(2) 


...00010(2) 



Table 43 
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Field-based Prediction fin a frame picture 

In this mode, each field is treated independently. A separate vector is used for eech of the 
two fields. Associated with each vector is an addiiional single bit flag 
(motion_vertical_field_select) that indicates whether prediction should be made from the 
top reference field or the bottom reference field. The bottom bit Df the vector still indicates 
the need for half-pel filtering, but bit 1 has no special significance. Note that a field vector 
measures different units of a frame vector; a field vector with the value n represents the 
same actual displacement (on the glass) as a frame vector with the value 2n. 

This time, however, there are sixteen cases to consider (since there are four binary 
variables; nnotion_vertical_fi*ld_select for e B ch of the two vectors and bit D for each of 
the two vectors). There are loo many cases to draw, hence, the following figures only deel 
with the prediction of the top field. T/ie bottom field is obtained in an analogous manner. 

As depicted in Figure 75. motion_vertical_field_seJ»et = 0, vec(Dr[0) = 0 

8{4) lines are read from the top reference field to form the lop field of the prediction. 

Figure 76 shows motion_vertieal_field_se!ect = 0, vec/o/JO) = 1 

9(5) lines are read from the top reference field which are then half-pel filtered to form the 
top field of the prediction. 

Lkewise, Figure 77 depicts motion_vertical_fleid_select = 1 , vector [0] = 0 

B(4) lines are read from the bottom reference field to form the top field Df the prediction. 

And, Figure 78 illustrates motlon_venical_field_select = 1, veefwfD) = 1 

9(5) lines are read from me botlom reference field which are then half-pel filtered to form 

the top Held of the prediction. 

Dugl Prime fin freme pjfluasj. 

Dual prime is a special case of the Field-based prediction of the previous section. 
Essentially, dual-prime combines two features; 



• A special method of coding the vectors so that despite the fact that four 
independent field predictions are formed (independent in the sense that they 
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each have a distinct veclor) effectively only one motion vector is transmitted 
Thus, the vector overhead is dramatically reduced. 

• For each field, the prediction information is read from each of the reference 
fields. This is then averaged to form the final prediction. This is very similar to 
the B-picture case when a separate forward and backward prediction is made 
and then averaged. 

In the present invention, the vector decoding will all be performed in the parser 
Accordingly, when the prediction circuitry receives data, there really will be four separate 



The dual-prime averaging will be performed by reusing the B-frame averaging circuitry 
(dual-prime cannot itself be used in a B-frame). Hence, the only associated complication 
for the prediction circuitry is involved in the signaling that indicates that the Backwards 
predictions (using backwards vector iokens etc.) should be performed from the to/warrf 
£ reference fields (eg opposed to the backward reference fields]. Since a P-picture should 
never normally request a backward prediction, the prediction circuity merely needs to keep 
a record of the picture type (P or B) in order to be able lo decide which reference store to 
use for a "backward" prediction. 

Prediction in Field Pictures 



This is very similar to field-based prediction in freme pictures. There sre four cases 
depending on motion_vert;<: a l_f,eld_ se lrct and the least significant bil of the motion 
vector. Note that it is not really relevant to discuss lap-fields and bottom-fields in the 
prediction thai is formed, since the prediction is simply for the picture being decoded 
(which is either all top-field or all bottom-field). 

Figure 7S illustrates motion, vertical_lield_select = 0. veeto/[0) = 0 

16(8) lines are read from the top reference field to form the prediction. 

Figure 80 shows molion_vertica!_f!e!d_se!ect = 0. vectoty) = 1 

17(9) lines are read from the top reference field and half-pel filtered to give the prediction. 
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Figure 81 depicts motion_vertical_fieJd_select * 1 , vtctor\0] = 0 

15(B) lines are reed from the bottom reference field to form the prediction. 

Figure 82 shows rr>otion_vertical_fieId_select = 0. vee/orfD} = 1 

17(9} lines are read from the bottom reference field and half-pel filtered to give the 
prediction. 

16x8 MC 

In this mode, the macroblock is divided into two 15x8 regions, one 2bove the other. For 
each region, s separate field vector is transmitted. Again, there are sixteen cases id 
consider (since there are four binary variables; motion_yertical_field select for each of 
Q the two vectors and bil 0 for each of the two vectors). Again, these are too many cases 
to illustrate so the following figures need only deal with the upper 16x8 region. The lower 
region is obtained in an analogous manner. 

Figure 83 shows motion_vertical_field_select = 0, veciorlO] = 0 

, B(A) lines are rear! from the top reference field to form the prediction of the upper 15x8 
region. 

Figure W depicts motion_vertlcal_fi eld_setect = 0. vec/orfO] = 1 

9(5) lines are read from the top reference field and half-pel filtered to form the prediction 
of the upper 16x8 region. 

^ Figure 65 illustrates motion_vertieal_field_selec1 = 1, vetforfO] = 0 

8(4) Lines are read from the bottom reference field to form the prediclion of the uddc 1 6xB 
region. 

Figure 66 depicts molion_vertical_field_selecl = 1. veaoi\Q) - 1 



9(5) lines are read from the bottom reference field and half-pel filtered to form the 
prediction of the upper 16x8 region. 
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Dual Prime in Field Pictures 

Dual prime in a fieliJ picture is simply a special case of field prediction in a field picture 
Two field vectors will be used (one will refer to the top reference field, on te the bottom 
reference field and the Parser will ensure this). One of the predictions will appear to be 
making a backwards prediction, but because this, is a P-pidure. the prediction circuitry will 
interpret this as a second forward prediction. The two resulting predictions will then be 
averaged using the same circuitry es thai used for B-frame averaging. 
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Overall organization 

Figure 67 shows the overall organization of the display pipeline, in accordance with the 
present inventioa Data arrives from the DRAM interface on a single multiplexed interface. 
Moreover, the DRAM interface will supply data in lines that are rounded up tD the next 32 
byte boundary above the correct number of bytes. However, the pels toward the end of 
the line that may lie outside the intended display area. 

In addition to the data, the ORAM interface will supply one bit for each channel (Y, Cr and 
Cb). that indicates whether the byte is the last in the current display line. A lurth'er bit is 
supplied that indicates which field the data comes from. 

The first block In the display pipeline of the present invention splits apart the three 
channels. Chrominance (Cr and Cb) dele is supplied to the vertical upsamplers 210. 
Luminance (Y) data can be delayed in a FIFO if desired 

The vertical upsamplers 210 have the lask of upssmpiino the chrominance data by a 2:1 
factor so thai there ere as many lines of chrominance data as there are of luminance date. 
In order to do this the vertical upsamplers store each line of chrominance data and 
produce output pels that are interpolated between ihis line and the subsequent line. 

The next stage in the display pipeline is labeled '■Horizontal Align 370". This is 
implemented as part of the horizontal upssmpler 212. Its task is to alien the dels sDthat 
at the start of each line, the first pel of each of the three channels is supplied to the 
horizontal upsampler 212 correctly. At the end of each line, il is expected that, in general, 
the channels will "run out of data" at different times. The "Horizontal Align" block 370 has 
the job of discarding this extra data from the channel* that have too much data while 
stalling the other channels so that they wait until all three channels are aligned and ready 
to commence the next display line. 

In the invention, the horizontal upsamplers 212 upssmple the data horizontally lo stretch 
the data to fill the glass of a TV screen. In order to save silicon aree, the filter is shared 
between the three channels. This can be done because the total output rate of the filler 
must be 27 Mbytes/s (the clock rate). The data is multiplexed in the CCIR 601 order so 
that the data stream produced is simply multiplexed into the final date stream. 

Note that the horizontal upsamplers 212 merely take the amount of data supplied by the 
DRAM interface anc scale it by a selected fscior In general, they will produce loo little or 
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too much data for the actual line lengih in me faster. This, is handled in the output 
multiplex. 

Also, note that the "Horizontal Alien" block 370 does not need to know how many pels of 
each channel will be required to complete the line. It is very difficult to calculate this 
number because the relation between the number of input pels to output pels for the 
(jpsampling filter is not very simple. The Horizontal Align block 370 simply supplies data 
to the horizontal upsampier 212 on each of its three channels "on demand," i.e.. the 
horizontal upsampier "pulls" the required number of pels inlo it in the required order. At 
the end of the display line, one of the channels will run out of dais first and this indicates 
that the remaining data for the other channels (if any) should be discarded. 

The VTG 333 simply counts through the raster and produces a series of timing signals that 
are supplied to the output multiplex 371. Some of these signals are internal signals which 
tell the output multiplex 371 how to build me final raster. Other signals are "external" 
signals, such as sync and blanking, and those are bIsd supplied to the output multiplex 
371 circuitry so that they are delayed by the same number of clock cycles as the data. 

The output multiplex 371 block has several lasks. The most interesting of these is 
probably Ihe'lask of removing the two wire "inlerfaceness" from the data. Data supplied 
from the horizontal upsampier 212 still has an associated valid signal (and the output 
multiplex provides an accept signal). D3I2 at the output of the multiplex has no two-wire 
interface, it is simply clocked out. one byte per clock cycle. 

The output multiplex 371 also has the job of painting a border around the piclure. The lop 
and left borders are painled under the control of the VTG 333. The VTG 333 simply tells 
the oulpul multiplex 371 to produce the requisite number or pels of border color. At the 
right and bottom of the picture, the output multiplex 371 paints its Dwn border. i.e., it knows 
to do Ihis because it runs out of picture data. 

The final block in the display pipeline is the 8-bit to 1 5-bit output mode convener 372. This 
is quite simply a flip-flop and a multiplexer. It is intended that this be implemented at the 
output PAD itself. By doing this, it is possible to simply route an S-bit bus, rather than a 
16-bit bus. Each bit will go to two output pads. 
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Horizontal Upsampler 

Introduction 

In accordance with the invention, the Horizontal Upsampler 212 performs the task of 
upsampling or interpolating the decoded picture in order to stretch it to tit the display 
raster. 

The upsampler 212 of the present invention can operate in four modes: 

1 ) 1:1- Output is the same as the input 
2} 2:1 

3) 3:2 

4) 4:3 

£ After some picture simulations and consideration ot likely implementation costs, it has 
been deeded to use a three tap filter to perform the interpolation. 

The filler is a "polyphase" filter in the sense that each successive output is generated 
using e different set of filter coefficients The number Df phases is always equal to the 
numerator of the upsampling ratio. Thus, the 4:3 upsampler hes four phases, every fourth 
output sample being generated using the same filter coefficients. 

Since the upsampler 212 is generating more output data then it accepts as input data, it 
is dear that a new input sample is not accepted on every clock cycle. In fact, the number 
of phases on which the filter does not accept new input is the difference between the 
numerator and the denominator of the upsampling ratio. In each of ihe ratios {except 1 : 1 ) 
this is one. Therefore, for each complete cycle around the phases, on one of the phases 
no new input data is accepted. In this case the daia is the same as for the previous phase. 
^ The filter coefficients are, however, different to the previous phase. 

4;3 Ups?rnpling 

In 4:3 Upsampling. the filter coefficients are shown in Table 44 while Figure BB shows the 
filter in operation. The output pels are essentially formed as weighted averages of the 
input pels. 
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Phase 


CFOJ 


C[1) 


CI2] 


0 


0 


356 


0 




42 


220 


■6 


2 


126 


128 


0 


3 


-6 


220 


42 



Table 44. 4:3 Filter Coefficients 
Note thai no new input date is accepted before thB final phase (phase 3) is calculated. 
3:2 Uosamplinn 

Table 45 illustrates 3:2 upsampling. while Figure 83 illustrates filler operation. 
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CfO] 


C[1] 


CI2J 
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256 
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68 


194 


-€ 
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-e 


194 


6E 



Table 45. 3:2 Filter Coefficients 

?1 tlosamolinn 

Likewise, Table 46 illustrates 2: 1 upsampling and Figure 90 shows filtering thereof. 



Table 4S, 2:1 Filler Coefficients 

Note that Phase 1 could equally well have been described as having filter coefficients, 
128, 128. 0. This has the advantage that the filter coefficients would then be Ihe same as 
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for Phase 2 of the 4:3 upsampler . However, it has the disadvantage that the rule "no new 
input is accepted when computing the test phew" would not be true. 

Boundary Effects 

At the edge of the picture, it is necessary lo produce output pels that are formed from pels 
that lie outside the picture area. In order to avoid this problem, it is necessary to pixel- 
repeat edge pels so thatihe filter may proceed without realizing that li is at the edge of the 
picture. 

in the case of a three tap filler, as in the present invention, il is necessary lo repeal just 
one pel at the left of the image and one at the right. (A five tap filler would have required 
2 at he left, 2 at the right). This is shown in Figure 91. 

Conceptually, therefore, the implementation could be viewed as being formed of two 
boxes: 

Note the scheme doesn't really work properly in the case that the picture is not a multiple 
of 16 pels wide because the DRAM interlace will always supply data that is a multiple of 
1B pels wide. 

However, alihough this problem is known, we are not Qoino to do anything about it. Mos! 
picture are multiples of 16 pels wide anyway, and in any case il is only the very last pel of 
the line that can be affected by the boundary effect. This is illustrated in Figure 92. 

The Number of Output Pels 

In the present invention, the upsampler will produce a defined number of output pels for 
a given number of inpu! pels. This is important because this allows the parser Stele 
Machine to decide how many pels will be produced at the output of the upsampler end. 
hence, how many pels need to be cropped (or border pels added) in order for the picture 
to fit into the raster. 

The first valid output from the horizonlal upsampler should occur in response lo the third 
pel being input to the upsampler (since this is a three tap filler). Since one pel is repeated 
this will occur when the second actual pel is input lo the upsampler. 

The last valid output should occur when ell of the possible output samples have been 
produced in response to the last (i.e., repeated) pel being input. Since the last phase of 
the poly-phese fillers is computed using the same input data as the second-last phase, il 
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is possible that either one or two output pels are producefl es a result of this last repeated 
pel entering the opsampler. 

If this is done, the upsampler will produce "q" output samples: 
£0 1. 

Q=A/(pDIVMJ + (pREMM; 
in response lo "p" input samples for an N:M upsampler. 
For example, for a 4:3 upsampler. Table 47 could be drawn up as follows: 



p 


q 


(input pels) 


(output pels) 


1 




2 


2 


3 


•4 




5 


5 


6 


6 


8 



Table 47. Number of Output Pels for 4:3 Upsampler 
Position Signals 

Two signals are transferred along with the video dat2 in the present invention. They allow 
the output multiplex to ensure that the data is painted into the appropriate position in the 
output raster. These are: 

lasf_injine 
fieldjd 

last_in_line is active for one pel time and signals that the associated pel is the last pel in 
a scan line. 
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fieldjd indicates which field the dale belongs to. "0" indicates the spatially upper field 
"1" indicates the spatially lower field. Note that this designation applies before any border 
lines and the like, are applied to the decoded image, fieldjd changes state one pel too 
eariy, i.e., between the second to last and the last pel of the field. This allows the last pel 
of the field to be identified without wailing for the first pel of the next field. However there 
may be no "next field" if decoding slops for some reason. The field id signal is shown in 
Figure 93. 

if a true field indicator is required, ii can be obtained by delaying fieldjd by one pel time. 

Since these signals work their way along side the data through the entire display pipeline 
it is important 10 use two signals, nol three (which would allow a last pel in field signal] 
because It saves many flip-flops. 



When position signals are applied 10 multiplexed data, care needs to be taken. 
The data is multiplexed in the order; C„ Y C, Y . 

In the present invention, the three samples (C s y C,) are co-incident in time and should, 
therefore, be viewed as indivisible. The remaining byte ( T ) is positioned between the 
preceding (C, , C,] pel and the subsequent [C. T C,) pel. 

As a result, the last byte in the line will either be the C. or v . (Note that upsampling by 3-2 
may produce en odd number of Y pels.} If the last byte in the lines is C r , then, there should 
be a discontinuity in the multiplex signal because the first byle of s line is always C t : 

(C 6 Y 1 C r )( Y ){C,Y,C,WC b Y 1 C 1 X,)(C.Y,C l ) 
Horizontal Alignment 

At the input of the upsampler. there is no guarantee thai the three different channels will 
line up. 

in order to achieve alignment, in the present invention, a "prolocol" between the horizontal 
upsampler and the horizontal alignment blocks needs to be aoreed. In accordance with 
the present invenlion. tne protocol performs as follows- 
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• The horizontal block supplies pels, on demand, to the horizontal upsampler 
When it runs out of data for a given channel, it will signal this to the filter using 
a signal marking the last pel of the line. This will only happen for the repeated 



The horizontal upsampler ensures thai once it has been supplied the last pel 
lrom a given channel it will not ask for another pel from that channel in the 
current tine. However, the filler continues to operate, taking any necessary 
pels from other channels, until just before it will demand a pel from the channel 
that it knows has run out of data. The filter marks the last pel it can produce 
at the output as the last in the line. At this point, h resets itself as ready for the 
next line of dala. 



• When the horizontal upsampler sees the filter accept data for a channel that 
has already been exhausted, it knows that the filter is askine for the first pel 
of the next line. At this point, any remaining pels on the other two channels 
are discarded. The next pel that wit! be supplied on each of these channels 
will be the first pel Df the line. 

Although it is-convenient to think of two separate blocks (the horizontal alignment block 
and the horizontal upsampler filter) it is likely that the two will be implemented together 
In order to explain the operation. 

Upsampling Ratio 

The upsampling ratio will be supplied to the filter as e two bit binary number. In order thai 
the filter operates in a sensible manner, the upsampling ratio should be ssmpled by the 
upsampler itself, once per field lime. The circuitry supplying the ratio is then free to update 
the sampling ratio, in readiness for ihe next field, at any time during the current field. 

The ratio should be sampled as the first pel of each field is actually accepted (rather than 
just after the last pel of the previous field). !n this way, the very first field after reset (or 
after some pause in decoding) is upsampled with the correct ratio 
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Video Timing Generator 



This section describes the video timing generator circuit {VTG 333) in accordance with the 
present invention. Trie VTG is primarily responsible for generating the various analogue 
video synchronizing signals, and aiso lor maintaining knowledge of the display system's 
current raster position. This enables the VTG to provide controlling signals for the output 
multiplexer, which selects between active video, border and blanking sources (or output 
Both analogue and digital standards are supported, with two frame sizes {PAL and NTSC) 
and associated synchronizing behavior, selectable at setup. Border or cropping width will 
be specified in a joken which will load a hardwired input to the VTG, 

Horizontal Timing 

The horizontal timing parameters are illustrated in Figure 94. These are split into those 
that are fixed (lor either PAL or NTSC) and those that are variable {i.e.. the parameters 
associaled with any borders or cropping that may be specified. 

The interlaced nature of the video being displayed imposes a requirement for half-line 
based counting, so than various timing points are shown separately tor each hall ot the 



A line comprises an initial blanking period, the insertion of a SAV token, an active period, 
the insertion of an EAV token, and the trailing Clanking period. During blanking lines, lhe 
active area. will have blank values inserted rather than border and data. 

A tine sync pulse appears at the beginning of every line (HSYNC). On certain blanking 
lines, two sync pulses appear, one at the Deginning and the other after the first half line 
The width of these is dependent on which vertical region is active: equalization or 
£ serration (field sync). 

During the initial horizontal blanking period, pels are discarded according io the cropping 
value {if the crop bit is set) - a fixed period of 120 cycles is allowed to discard the RHS 
cropped pels from the preceding line. The LHS pels (or the current line are then 
discarded, and pels are stalled until the start of the active region. It is essential that there 
are no gaps in the data stream from which pels are being discarded, otherwise distortions 
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If the crop bit is not set, however, a border is consirucied by inserting border value for 3 
period of borderL; followed by data for picture width, and then border again until the end 
of the active region. Note that it is not necessary 10 calculate the borderR vaiue. 

The total horizontal border or crop width is specified in pels. The LHS border/crop value 
must be a multiple of 2 pels in order for the sampling to remain consistent. Consequently, 
it must be a multiple of A in terms of clock cycles. This can be achieved by masking out 
1h« least significant 2 bits from the original total border value in pels. For example, if the 
specified border is 91 pels, the left border will be BS cycles long, and thB picture width will 
b* (720- 91 )*2 cycles. 

Streams ot pels arriving at the output max are padded to give blocks of 32 pels. 
Considering this, together with the scaling factors to be supported, the maximum number 
of pels to be received for a line will be 832. This means that the maximum crop value will 
be 112 pels, giving 112 cycles of cropping at the LHS and the RHS. 

^ Vertical Timing - PAL 

The vertical timing parameters for PAL in accordance with the present invention, are 
illustrated in f igure 95. Two fields are shown separately, as they have slightly different 
timing. Analogue parameters are indicated by the shaded regions, being identical for each 
field, and digital parameters are shown by the waveforms. For simplicity, the zero-border 
case is shown. If a non-zero vertical border is specified, border is inserted for a period of 
borderT, then data for picture height, then border again until the end of the active reoion 
(fixed). BorderT and picture height are calculated in a way analogous to borderL and 
pieture width (in horizontal timing) respectively. Once again, the initial border (borderT) 
must be z multiple of A. this lime in terms of half lines because the top border must be a 
multiple of 2. 

Note that MPEG codes 576 lines of video for PAL. whereas the analogue standard 
£ specifies only 525. This difference is accommodated by selecting data for output for 576 
half-lines per field, but only asserting the analogue blanking signal for the requisite 575 



Vertical Timing • NT5C 

Next. NTSC vertical timing, in accordance with the present invention, is illustrated in Figure 
96. It is similar in principle to the PAL timing, although slightly more complex MPEG 
codes 480 lines of video for NTSC, whereas the analogue standard specifies 483 This 
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means that 3 lines of border must be insened per frame to fill the gap (3 half lines per 
field), in addition, the judicial vertical blanking indicator. V. is specified in such a way mat 
additional border lines are required to be inserted as padding before the active video lines 
Non-zero vertical borders will be insened in addition to those lines already indicated as 
described in the previous section. Furthermore, noie that vertical cropping is not allowed 
in either standard. 

There is. at present, some uncertainty about the digital blank signal, V, since various 
reference sources give conflicting information. There are two main timing possibilities 
illustrated by V and V. with the associated border select signals SB and SB', respectively.' 



The video timing generator of the present invention comprises separate machines for the 
• horizontal and vertical liming domains. The vertical machine provides control signals for 
the horizontal machine, which, in turn, provides the half-line increment signal for the 
vertical counters. 

Inputs to the VTG are: 

clocks and reset 
PAL not NTSC 

horizontal border value with crop indicator 
vertical border value 



horizonlal. vertical and composite sync and blanking signals 
select signals for data, border, blanking 
a discard data bit for cropping 
insert SAV and EAV 

F and V values for construction of SAV and EAV 
a 2-bit YUV position counter for SAV/EAV insertion 
a firstiine bit to indicate the start of a picture at startup 

All of the outputs go to the output multiplexer block, including the svnc signals which cen 
then remain in synchronization with the data. 
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Horizontal Machine 

The horizontal machine is essentially a counter with hardware to detect the arrival of the 
various timing poinis as shown in Figure 94. The count goes from zero to half line length 
(which is different for PAL and NTSC) and is repeated for each half line. A hardwired 
comparator exists for each of the fixed timing points, these being activated according to 
the standard. In addition, there is a register for the border value (which is polled once per 
field), a subtracter id deiermine ihe picture width, and an auxiliary counier for counting 
down from the border value to zero. This procedure occurs in parallel with the main halt- 
line coining. The datapath is 10 bits wide, and 15 hardwired comparators are required to 
Implement both PAL and NTSC. The structure of this current embodiment is shown in 
Figure 97, together with approximate Si2es. The datapath is estimated to be 3SDu x 330u. 

In addition to the datapath, most of the control logic in the VTG of the present invention 
will be associated with the hori20ntal machine. This will probably amount to 100-200 
gates. 

Inputs to the^horizontal machine are: 
clocks and reset 

horizontal border value and crop bit 
line, equalization or field sync indicators 

• PAL not NTSC 
vertical blank 
insert veflical border 

Outputs from the horizontal machine are: 

horizontal and composite blanks 
insert data 

♦ insert border 
insert blank values 
discard input 

insert SAV or EAV, with YUV count 
hsync 

composite sync 
start of line 
half-line increment 
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Vertical Machine 

The vertical datapath has essentially the same structure as the horizontal datapath but 
with22 hardware comparators (8 for PAL. 14 for NTSC). The principal counter increments 
-each half line, counting the half-lines through each half line, and counting the half-lines 
through each field, in turn. It is also 10 bits wide. 

Moreover, it is advantageous for (est purposes to multiplex the half-line pulse input with 
another, more frequent clock, so that the vertical machine can be run independently of the 
horizontal machine. 

The estimated size is 360u x 420u. 

Inputs to the vertical machine are: 

clocks and reset 
PAL not NTSC 
vertical border value 
balf-kline increment 

Outputs from the vertical machine are: 

select equalization, field or line sync 
vertical blank (analogue) 
vertical sync 

F. V and V bits for SAV/EAV construction 
insert vertical border 
insert data 
insert blank value 
start of frame 

Hardwired Comparator Design 

in the present invention, the hardwired comparator design is based on a string of series 
n-type transfers, either pre-charged or with pull-up, organized in 3 similar sl y [8 , 0 
memory row decoders. Typically, these comparators will be about 6u high in the aree 
estimates given. 
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Output Multiplex 

The output multiplex of the invention has the task of putting together the data for display. 
It combines data arriving from the earlier sections of the display pipeline with timing 
information obtained from the VTG. 

The other input ttsk of the output multiplex is to remove the twD-wire interfacing. All the 
pipeline stages up to the output multiplex have a two-wire interface, indeed the data 
arriving, aline input of the output multiplex will always arrive too early and will be stalled 
by taking accept low. However, there is no two-wire inlerface at the output of the device. 

In order to achieve the above removal Df the two-wire interfacing, the dynamics of the 
supply of data need to be sorted out so that the DRAM interface never stalls the data 
arriving et the output of the horizontal upsampler. 

Basically, the output multiplex is making a decision on s field by field basis as to whether 
to outpui a field of data or not. At some point, close to the start of the first active line of the 
field, the output multiplex makes a decision. If there is valid data waiting at its input (i.e., 
in_aecept is low) then il will start to output the data. If, on tne other hand, there is no valid 
data [for example, before the first picture has been decoded} then it will paint border color 
through the entire picture. 

Actually, this procedure is slightly more complicated because the output multiplex must 
hIso ensure that tne data is painted into the correct field. That is, there must be valid dsts 
waiting that belongs to the correct field before the display commences. 

If at some point the tiate ceases to be valid, si a time that the output multiplex expects to 
have vBlid data available to paint into the display {which should never happen) then the 
output multiplex reverts lo ouiputling border color wnich il continues to do for the 
remainder of the field. 

Border Generation 

Figure 98 shows the generation of border color to the left and right of the picture display 
in accordance with the present invention, . 

As shown, the VTG generates the border region at the left of the picture by asserting e 
signal that selects border color in the output multiplex However, at the right hand side" of 
the picture, the border color is generated by the output mulliplex itself. It does this by 



F8- 1 7 2 6 2 4 



recognizing that it has "run out" of data and paints the remainder of the width of the picture 
in border color. 

It must be understood that there are two possible interpretations of "run out" of data. One 
is that the output data from horizontal upsampleri5 not valid. However, this is not what is 
meant here. In this case, one runs out of data after the pel that is marked by the 
last_in_line signal as going the last one in the line has been included in the output 
stream. Figure 99 shows the equivalent action when clipping of the picture occurs. 

As shown, the VTG signal* to the output multiplex Id clip pels to the left of the picture by 
asserting a signal to tell the output multiplex to discard input pels. Once this has occurred, 
the VTG will signal that the output multiplex should stan to output the remaining pels. At 
the end of the active line {i.e.. 720 pels later) the VTG de-asserts the signal and the output 
multiplex discards any remaining pels in the d2ta on its input. Note that, in general, there 
W w'll be a gap (in time) between the time when the VTG indicates that cropping should occur 
and the start of the active line. This significantly simplifies the design of the VTG. The 
output multiplex discards pels when the crop Signal is asserted and then waits until the 
start of the active line period. 

Output multiplex 

The output multiplex controls the multiplexing of various sources of data together Id form 
a CC1R 601 S bit multiplexed data stream. 

The timing (i.e., what is multiplexed in and when) is largely controlled by the VTG. The 
output, multiplex is concerned with higher level issues. For example, at the start of 
decoding, when no pictures are available for display, the output multiplex will be painting 
border color throughout the entire image. Eventually, the first decoded picture will arrive 
^ at the output of the horizontal upsampler. Typically, this will not occur conveniently at the 
™ start of the field. The output muliiplex asks once per field time "is there valid data ready 
for display?". If not, it wails for the next field to occur (and any valid 'ate that happens lo 
turn up in the meantime has to wait for the start of the next field). 

The output multiplex also ensures thai the correct field of data arriving from the SDRAM 
interface is painted into the correct field of the PAL or NTSC raster. 

In addition, lo dealing with the data, the output multiplex also selects the correct sync and 
blanking signals for outputting to the pins. This facilitates easy connection to a wide range 
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of comoosile encoders, DAC's. and the like. The registers for the output multiplex are as 
shown in Table 48. The bits for the output multiplex control are illustrated in Table 49. 

There are four bytes of MPI registers associated with the output multiplex: 



Register Name 


| 


I 

! 


Description 


bordor_eb 


8 


OxCO 


Cb component of border color 


border_y 


6 


0x80 


Y component Df border color 


border_cr 


e 


0x40 


Cr component of border color 


outmux_etrlL 


e 


zero 




Table48. Outmux registers 






I 




Register Name 




I 


Description 


hs/cs 


0 


0 


Controls whether horizontal sync or composite 
sync is present on the hcsync pin, 

0 selects composite sync 

1 selects horizontal sync 


hcsync_ah 




0 


Controls the parity of the hcsync pin. 

0 selects active low 

1 selects active hioh 



>* 7 
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Register Name 




I 

I 
a 


Description 




v*yne_ah 


.2 


0 


Controls ths parity of the vsync pin. 

0 selects active low 

1 selects active high 




cblank^ah 


3 


0 


Controls the parity of ihe cblank pin. 

0 selects active low 

1 selects active high 


• 


bianking601 






Controls and value of """•>"«• oaIa that is output 
during blanking. 

0 selects the value zerol 

selects the value 0x10 (sixteen) 

For CCIR 601 dsia this pin must be set t D 1 




enbl_sav_eav 


5 


0 


Controls the oeneration of SAV end EAV control 

0 suppresses SAV and EAV, in which esse, 
blanking values are output at the times when 
SAV end EAV would otherwise be generated. 


• 








1 enable SAV and EAV. Note that blanking601 
should also be set to 1 to avoid ihe value zero 
appearing at 1he output except during SAV and 
EAV. 

For CCIR 501 data this pin must be set to 1. 
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f 




Register Name 


is 




Description 


b!ank_*ereen 


6 


0 


When set to 1, this bit causes border color to be 
painted ever the entire screen, thereby blanking 
the screen. Note that decoding continues as 
normal, but the decoded pictures are rendered 
invisible. 


vblank 


7 




This is a read-only bit (data written to this bit is 
ignored). II indicates vertical blanking. 



Table 49. Bits from Outmux_Ctrl 



a. Irrespective bl the setting of this bit, chrominance data (both Cb and Cr) will be 
• OxBO (128 decimal) during blanking. 
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Video Decoder Specifications and Features 



In addition to the aforementioned deiailed description, the following disclosure is also 
provided regarding a preferred embodiment of a video decoder suitable for practice of the 
invention. 



. MPEG-2 MP @ ML 


• 2/3 and l/i pulldown 


. Single 16 Mbit SDRAM 


■ Video scaling 


• High resolution MPEG-1 


• Power including SDRAM = 2.5 W 


• o Vision compatible 


• Self configuring 


■ Automatic error concealment 


■ Small board area 


• Channel change support 


• QuietPad™ outputs 


■ Time stamp management 


• On-chip video liming generator 



The present invention includes a highly integrated, easy to use. MPEG-2 video decoder 
It fully supports all the requirements of MPEG-2 Main Profile at Main Level. 



The syslem of present invention is also self configuring (a single pin selects between PAL 
and NTSC operation) and. in many applications, can sian-up and maintain video decoding 
with no external sofiware support. Error concealment and recovery is fully automatic. 
More demanding' applications may utilize the advanced features controlled by software 
running on an externa! microprocessor. 

The present invention stores its own microcode in an on-chip ROM. thus avoiding the need 
to use an external ROM or download microcode before decoding can commence. See 
Figure 100. 



• 
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The following more detailed description of the system of the present invention is set forth 
for purposes of organization, clarity and convenience of explanation under the headings 
listed below: 

Signals 

Register map 

■Power supplies 

Logic levels 

Clock signals 

Reset signals - 

Coded data interface signals 

Supply data via the microprocessor interface 

Switching between input modes 

Rate of accepting coded data 

Coded data interface timing 

CDCLOCK 

Video output signals 

Video output control registers 

Borders, scaling and cropping 

Video output control registers 

Video signal timing 

MPI signals . . « " 

MPI electrical specifications 

Interrupts 

Page register 

SDRAM interface signals 

SDRAM configurations 

Connection of JTAS pins in non-JTAG systems 

Supported Instructions 

Characteristics 

Level of Conformance to IEEE 114S.1 

Start code detector registers 

Detection of stan codes 

• discard_all facility 
flag^picture_end facility 

start_code_search facility 

SCD example - channel change • 

Parser registers 

Error codes 

Dealing with user data 

System organization 

Signals and registers 

Electrical specifications 

Coded data interface 

Video output interface 
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Microprocessor interface 

Synchronous DRAM interface . . 

JT AG interface 

Start code detector 

Video parser 

Timestamp management 

Address generator configuration 
Mechanical information 
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This section includes a listing of all the signals (pins) used, in accordance with the present 
invention, and a listing of all the registers available through the microprocessor interface. 
(See Tables 50 and 51.} 



Signals 



Skjnml Name 


uo 


Pin Number 


Descriotion 


CDCLOCK 


1 


137 


Coded Data Interlace. u»d 


CD[7:05 


1 


133.132.130.12S.128.127.125.12* 


tD stlDOly coded data or 
Tokens Id the system. 


CDEXTN 


1 


134 


CDV'ALID 


1 


123 


CCDACCEPT 


0 


122 


BMODE 


1 


135 


ME[1:0) 


t 


99.se 


Micio Processor Interface 


MfVW 


1 


97 


(MPI) 


MA|S:0] 


1 


107.106.104.103.102. 101 


MOr7;0] 




116.118,117.116.114.113,112. 
111 


IRO 


o 


96 


DD|1S:C) 


I/O 


36.35, 33 32.30. 25. 27, 25. 21. 20. 


SDRAM Interlace 


DAJ10.0] 


0 


152.1S3.K3. 14*. 146. 147,149. 
150.159. 158.156. 153 


BS 


0 




DCKE 


o 


39 


DCLKOUT 


o 




OCLKIN 




23 


DWE 


0 




DCAS 


0 


8 


DiUS 


0 


E 


DCS(l:0] 


o 


3.2 


y|7:0] 


0 


52.53.54.55. S7.5S.5?, 60 


Video output interface 



/93 
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CR:0] 

HCSYNC 


0 

0 


42.-3.44.45 47.4B.4S.SC 
62 




V5YNC 


0 


64 




° 


65 




0 


68 
6S 


TDI 
TDO 


1 

0 


73 
72 


JTAG pan. 






75 
78 






?*&™-~~ 








4G. 56.76. «. aS .,0 S .,1 S . 12 ..,» 
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Sianal Name 


fO 


Pin NumDer 


Descrinton 


TPHDISH 




87 




TPH11SH 




68 


TSTRSTCTRL 




77 




TLOOP 




78 


Connect to GND or VDD during normal operation 


PLLSELECT 




83 


If PLLSELECT - 0 the on-chip phase locked loops are 
disabled. 

Set PLLSELECT - 1 for normal operation. 


PLLLOCK 


0 


M 




TDCLK 




es 





Table 51. Test Signals 



Register Map 

The register map of the present invention is divided into areas. The first 32 locations are 
required for the normal operation of the sysiem. There is only five bits of address. 

The next set of 32 locations are those in the address generation circuitry that are required 
to setup a non-default SDRAM memory map. 

The remainder of the register mep are registers that are only used for tesl and diagnostic 
purposes. These can be paged in instead of the address generator registers. 

Table 52 illustrates the register map ot the present invention. 



Address (hex) 


Interrupt Service 


See 


0x00 ... 0x03 


Interrupt service 




0x04 ...0x05 


Input circuit 




0x06 ... 0x07 


Start code detector 




0x08 ... 0x0a 


Timestamp insertion 




0x0b ... OxOf 


(not used) 




0x10... 0x17 


Parser 
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Address (hex) 


Interrupt Service 


See 


Ox1B ... 0x1c 


Output control 




0x1 d 


PLL control 




0x1 e 


DRAM PAD drive 
strength 




Oxlf 


page_seleet' 


Table 3-4 


0x20 ... 0x3f 


paged register access 





Table 52, Overview of Register Map of Present Invention 



Table 53 depicts the page select register. 



pace-select 


Registers Selected 


See 


0 


Addrgen user configuration registers 


Table 3-5 


1 


Built in self test and IDCT test registers 


Table 3-1 1 
Table 3-12 


7 


IM_plus lest registers and SCO test registers 


Table 3-13 
Table 3-14 


3 


Parser test registers 


Table 3-15 




Field/Frame test registers 


Table 3-16 


5 


BOB test registers 


Table 3-17 


6 


more BOB tesl registers 


Table 3-17 


7 


Addrgen lest registers 


Table 3-18 


S 


DRAM IF test registers 


Table 3-19 



Table 53. Page Select Register 
Table 54 illustrates the interrupt service area. 
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Address 
(hex) 


Bit No. 


Register Name 


age 


OxDO 


7 


ehip^event 






6 


end_searcfi_*veni 






5 


unrecogni2ed_sian_eve.H 






A 


flag_picture_end_evenl 






3 


parser_eveni 






2 








1 








0 






OxOl 


7 


chip_mask 






6 


end_search_mBsk 






5 


unrecofintzed^siarwna sk 






4 


fiag_piclure_end_mask 






3 


parser_mask 






2 








1 








0 






0x02 


7 








6 


idct_ioo_many_event 






5 








A 








3 








2 
















0 


walchdog_eveni 





/*7 
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Address 
(hex) 


Bit No. 


Register Name 




0x03 


7 


idClJOD_few_rnask 






6 


idct_too_many_mask 






5 
















3 








2 








1 








0 


watctidoo_masl< 





Table 54. Interrupt Service Area 
Table 55 shows (he input circuit registers ot trie present invention. 



Address (hex) 


Bit No. 


Register Name 


See Page 


" 0x04 


7 


roded_bu5y 




6 


enable_mpMnput 




5 


coded_extn 




4:0 


(not used) 




0xO5 


7:0 


cod ed_ data 




Table 55. Input Circuit Registers 
shows the start code detector register of the present invention. 


Address (hex) 


Bit No. 


Register Name 


See Page | 


0x06 


7 


scdp_access 




6 


[not used) 




5 


discard_extension 






discard user 




3 


3fter_ssarch_slop 




2 


fl8Q_picture end 





s9» 
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Address (hex) 


Bit No. 


Register Name 


See Page 






after_piclure_5lop 




0 


3fler_picture_diseaf(J 




0x07 


7:3 


(not used} 




2 


diseard_ali 




1:0 


Blarl code search 





Table SG. Start Code Detector Registers 
In accordance with the present invention, Table 57 shows the timestamp insertion registers. 



Address (hex! 


Bit No. 


Register Name 


See Paoe 


oxoe 


7:0 






0x09 


7:0 






0x0a 


7 






6 


ts^waiting 




5:0 


(not used) 





Table 57. Timestamp Insertion Registers 



Likewise. Table 58 illustrates the video parser registers. 





Bit No. 


Register Name 


See 
Paoe 


0x10 


7:0 


parser_cirl0 (aciually a reg file location - bits TBD) 




0x11 


7:0 


parser_drn (actually a res file location - bits TBD) 




0x12 


7:0 


parser_error_code (actually cons!, Held o( MSM ) 




0x13 


7 


parser_access 




6:0 


reg_keyhole_sddr 




0x14 


7:0 


reg_keyho(e_data 




0x15 


7:0 


(not used) 




0C16 


7:0 


user_keyhole_addr 
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Address 


Bit No. 


Register Name 


See 1 


(hex) 




JageJ 


0x17 


7:0 


user_keyhole_data 





Table 58. Video Parser Registers 



The output control registers are shown in Table 59. 



Address 

(hex) 


Bit No. 


Register Name 


See Page 


oxi e 


7:0 


border_cb 




0x1 9 


7:0 


border_y 




0x1 a 


7:0 


border cr 




0x1 b 


7 


vblank 






6 


blank screen 






• 5 


enbl sav eav 






A 


blankino601 






3 


cblank ah 






2 


vsync_ah 








hcsync„ah 








h5_nol_c£ 




0x1 c 


7:2 


(noi used) 






i:o 


vertical upsample control 





Table 59. Output Control Registers 

Test Registers 

Trie complete register mep is shown in Table 50 through Table 69. 
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Address (hex) 


Bit No. 


Register Name 


See Pag* 


P1+00 




test mode 


P1+01...PU03 




(not used) 




P1+04 




misr_mask 




P1+05 




(not used) 




P1+06 




misr[1) 




P1+07 




misriO) 




pi+oe 




psrg_biLseleci 




PI +09 




psrg_constant 




P1+Oa...P1+0c 




(not used) 




Pl+Od 




psrg[2] 




Pl+Oe 




psrg[1] 




P1+0f 




psrg[0) 





Table SO. Built-in Self Test Registers 



Address (hex) 


Bil No. 


Register Name 


See Page 


P1+10 




idct_clkgen 




P1+11 




(not used) 




P1+12 




snp_idcl{1] 




PI +13 




snp_idd[0] 




PVM...P1-H7 




nol used 




P1+18 




snpjram[7] 




P1+19 




snp_tram[6) 




Pi+la 




snp_tram[5} 




Pl+lb 




snp_lram|4) 




P1 + 1C 




snpjram[3) 




Pl+1d 




snp_lr3m[2) 




P1+le 




snp_lram[1) 





AO I 
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Address (hex) 


Bit No. ReqisterName 


See Pane 


P1+1f 


| snp_tram[0] 





Table 61. (DCTTest Registers 



Address (hex) 


Bit No. 


Register Name 


See Paqe 


P2-KJ0 




imp_clkgen 




P2+01 




(not used) 




P2+G2 




snp_iQuant[l] 




P2+03 




snpJquantJO] 




P2+04 




(not used) 




P2+05 




snpjmodep) 




P2+06 




snp_imodeI1) 




P2+07 




snp_imode|0) 




P2+08 




snp_iquanl_ram[3] 




P2+09 




snp_iquara_ram[2] 




P2+0a 




snp_iquant_ram|l] 




P2+0b 




snp_iqu3ni_ram[0] 




P2-*0c 




iquant_keyhole_dal2 




P2+0d 




ipuBnt_keyhoie_sddr 




P2+0e...P2+0f 




(no! used) 




P2+10 




snp_izz_ram[3] 




P2-11 




snp_izz_ram|2] 




P2+12 




snp_i22_ram[1] 




P2+13 




snp_izz_r3m|01 




P2+04 




iz2_keyhoie_data 




P2+15 




izz_keyhole_addr 




P2+16...P2+17 




(not used) 





Table 62. IM_plu5 Test Registers 



.3 02 • 
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Address (hex) 


Bit No. 


Register Name 


See Pace 


P2+18 




scd_clkgen 




P2+19 




(not used) 




P2+1a 




snp_incrct[1) 




P2-+16 




snpJneretIO] 




P2-Mc 




snp__cdbin[1] 




P2+1d 




snp_cdbin[0] 




P2-^e...P2+« 




(not used) 





Table 63. SCDTesi Registers 



• 



Address (hex) 


Bit no. 


Register name 


See page 


P3+00 




parser^clkgen 




P3+01...P3+02 




(not used) 




P3+03 




snp_cdboul[4] 




P3-KM 




snp^cdbout[3) 




P3-K35 




snp_edbout[2] 




P3-KK 




snp_cdbout[l] 




P3+07 




snp_cdbou![0) 




P3+08 




(not used) 




P3+09 




snp-aJuin[2j 




P3+D2 




snp-aluin[1] 




P3+Db 




snp-3luin[D] 




P3+Dc...P3+0f 




(not used) 




P3+10 


. 7 


msm_access 




6:0 


(not used) 




P3+11 


7:3 


(not used) 




2 


mssr_imr_s!atus 




1 


mssr_ss_monilor 





J° 3 . 
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Address {hex) 


Bit no. 


Register name 


See page 




0 


mssr_ss_select 




P3+12 


7:4 


(not used} 




3:0 


msm_pc 




P3+13 


7:0 




P3+14 


7:4 


(not used) 




3:0 


msm_ca!l_relurn 




P3+15 


7:0 




P3+1S 


7:4 


(noi used) 




3:0 


msmjntr.retum 




P3+17 


7:0 




P3+18 




snp_user_ram[7j 




P3+1S 




snp_user_ramI6) 




.. P3+i a 




snp_usei_ram{5) 




P3+1b 




snp_user_ram[4] 




P3+1C 




snp_user_ram[3] 




P3+1C 




snp_user_ram[2i 








snp_user_ram[1] 




P3*1f 




snp_user_rem[0) 





Table S4. Parser Test Registers 



Address (hex) 


Bit No. 


Register Name 


See Page 


P4+00 




ff clkoen 




P4+01 




(not used) 




P4402 




snp_fjdjrm[l! 




P4+03 




snp_fld_frm[0] 




P4+04 




snp^padder_d2i3(ij 




P4»05 




snp_padder_data!0) 
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Address (hex) 


Bit No. 


Register Name 


See Page 


P4+06 • 




snp padder_pf|l] 




P4*07 




snp_padder_pf|0] 




P4+0B 




snp_pf mesier[3] 
OnpMl[3]) 




P4+D9 




snp_pf_masier[2] 

'( E npsel[2] 




P4+Da 




snp_pf mester|1] 
(snpsel|1J) 




P4*0b 




snp_pf_master|D] 
(snp£-el|0) 




P4+0c 




snp^pf slave|3) 
(snpsel}7]J 




P4+Od 




snp_pf_slaveI2] 
(snpse![6]) 




P4+Oe 




snp_pf slavell | 
(snpsei[5)) 




P4 + 0f 




snp_pf_slave[0] 
<snpsel[4]) 




P4+10 




(not used) 




P4+11 




snp_pf__pipe[2] 
(snpselpOj 




P4-12 




snp_pf_pipe[1] 
(snpsel|9| 




P-4+13 




snp_pf_pipe|0) 
(snpseljB] 




P4+14 








P-4-H5 




ff_keyhple_addr 




P4-H6 




snp_dec_0ala[1] 




P4+17 




snp_dec_dala[0] 




P4+18 




snp_f!_ram[7} 




P4+1S 




snp_ff_ram[6] 




P4+1a 




snp_fi'_ram[5] 
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Address (hex) 


Bit No. 


Register Name 


See Pooe 


P4+1b 




snp_W_ram[4) 




P4*1c 




snpjf_ram[3] 




P4+10" 




5np_fl_ram[2j 




P4+1e 




snp_fl_ram[1J 




P4+1f 




snp_«_ram|0] 





Table 65. Field/Frame Test Registers 



• 



Address (hex] 


Bit No. 


Register Name 


See Page 


P5-I-D0 




boD_ciKflen 




P5+01 




(not used) 




P5+02 




snp_vup_cb[1) 




P54Q3 




snp_vup_6b[0J 




P5-H34 




anp_vup_cr|1) 




P5+05 




snp_vijp_cr|0] 




P5+06 




snp_hup_yfi] 




P5-»07 




snp_hup_y{0] 




P5+08 




snp_rKjp_cb[l} 




P5+09 




snp_hup_cb[0] 




- P5+0a 




snp_hup_cr[t] 




P5+0b 




snp_hup_cr[0] 




PS+Oc 




(nol used) 




P5+0d 




snp_outmux|23 




P5+0e 




snp_Qutmux[1] 




F5+Of 




snp_outmux|0) 




P5+10 




(not used) 




P5+11 




snp_v(gj2) 




P5+12 




snp_vtg|1) 
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Address (hex) 


Bit No. 


Register Name 


See Page 


P5+13 




snp_vtg[0) 




P5+14 




snp_ouliface[1) 




P5+15 




snp_ouiiface[0) 




P5+16...P5+1f 




(not used) 




P6+00...P6+07 




snp_vupram_cb1[7:0) (bobupram) 




P6+08...P6+09 




snp_vupram_cbOI7:0] 




. P6+10...P6-H7 




snp_vupram_cr1[7:0) 




P6+18...P6+1I 




snp_vupram_cr0[7:0) 





Table 66. BOB Test Registers 



Address (hex) 


Bit No. 


Register Name 


See Page 


P7+0 




addrgen_clkgen 




P7+1 












snoopers 





Table 67. Addrgen Test Registers 



Address (hex) 


Bit no. 


Register Name 


See Pape 


P8+0 




dram_cikgen 





Table 68. DRAMIF Test Registers 



Summary of Test Register Locations 



Address (hex) 


Data Bits 


Register Name 


Location 


P2+1a...P2+1b 


10 


snp_incrct[1 :0] 


The input of the chip 
(before the input circuit) 


P2+1C...P2+1C 


10 


snp_cdbin[1:03 


Input of cdbin 


P3+03...P3+07 


33 


snp_cdbou1[4:0] 


Input of cdbout 


P3+09...P3+0P 


19 


snp_aluin[2.0) 


Input of the ALU in the 
MSM 



<2<?7 ■ 
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Address (hex) 
P2+05...P2+07 


Data Bits 


Register Name 


Location 


19 


snp_imodel[2:0] 


Input of the inverse 


P2+02...R2+03 


13 


snp_iquanl[1:0J 


Input of the inverse 
quantizer 


P1+12...P1+13 


13 


snp_idct[1:0] 


Input of the IDCT 


P4+02...P4+03 


10 


*np_fkf_frm[1:0) 


Input of field-frame 


P4+04..P4+05 


10 


snp_padder_data[1:D) 


Transform data input of 
pfadder 


P4+06...P4+07 


8 


snp _padder_pfJ1:0] 


Pred. filter data input of 
pfadder 


P4*08...P4+0b 


23 


snp_p8dder_mas!er|3:0] 


Mester input of predflt 


P4+0C...P4+0t 


23 


snp_padder_master|3:Q] 


Slave input Df predflt 


P4411...P4+13 




snp_pf_pipe[2:0J 


Half way through predflt 


P4+16...P4+17 


8 


snp_dec_daia[l:0) 


Output of prediction adder 


P5+02...P5+03 


10 


snp_vup_cb[1:0) 


Input of chroma upsample 


P5+04...P5+Q5 




snp_VLfp_cr[i :□] 


— , ___ 

Input of chroma upsample 


P5+06...P5+07 


12 


snp_nup_yjl:0] 


Input of horizontal 


P5+06...P5+09 


10 


snp_nup_cD(i:0) 


Input of horizontal 
upsampler Cb 


P5+0a...P5+0b 


10 


snp_hup_cr[l:0] 


Input bl horizontal 
upsampler Cr 


P5+Od..P5+0f 


10 * 
strobes 
from vlg 


snp_outmuxi2:0] 


Input of outmux 


P5+11...P5+13 




snp_vigJ2;0J 


All control inputs (or VTG 


P5+14...P5+15 


13 


snp_outiface[1:0] 


Just before 8 to IS 
converter and retiming for 
the pins 



Table 69. Snooper Registers 



Jog 
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Power Supplies 



The present invention essentially operates from a single 5V supply. However, in order to 
enable simple connection to synchronous DRAM, a 3.3V supply is also provided. 



Symbol 


Parameter 


Min. 


Max. 


Units 


VDD 


Nominal S V supply voltage 
relative to GND 


-0.5 


6.5 


V 


VCC 


Nominal 3.3 V Supply voltage 
relative lo GND 


-0.5 


6.5 


V 


V w 


Input voltage on any pin except 
SDRAM interface pins 


GND - 0.5 


VDD + 0.5 


V 


V Miam 


Input voltage on any SDRAM 
interface pin.' 


GND - 0.5 


VCC + 0.5 




T A 


Operating temperature 


-40 


+B5 


•c 




Storage lemperature 


-55 


+150 





Table 70. Suggested Specification Ratings 11 



' Dp 5:0], DAp 1:0]. DCKE. DCLKOUT, DCLKIN. DWI, DCAS, DRAS DCSf1:01 and 
TDCLK 

* Stresses greater than those listed here may cause permanent damage to the device 
This is a stress rating only and functional operation of the device at these, or any other 
conditions above those indicated in the operational sections of this specification is not 
implied. Exposure to absolute maximum rating conditions for extended periods mav 
affect reliability. 



Symbol 


Parameter 


Min. 


Max. 


Units 


VDD 


Nominal 5 V supply voltage 
relative to GND 


4.75 


5.25 


V 


VCC 


Nominal 3.3 V Supply voltage 
relative to GND 


3.00 


3.60 


V 


GND 


Ground 


0 


0 


V 


T A 


Operating temperature 


0 


70 


•c 


Ido 


RMS power supply curren! 






mA 



Table 71. DC Operating Conditions 
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Logic Levels 

Three different signal interface types are implemented in accordance with the present 
invention. Standard (5 V) TTL levels ere employed by the microprocessor interface. In 
addition. 5 V CMOS levels are used by the coded data interface and the video output 
interface. 3 V LVTTL levels are 8lso employed by the SDRAM interface 

TfL (5 V) Levels 



Symbol 


Parameter 


Min. 


Max. 


Units 


V 


Input logic '1' voltage 


2.0 


VDD + 0.5 


V 


V t 


Input logic '0' voltage 


GND - 0.5 


0.8 


V 




Output logic voltage 




D.4 


V 


v ol « 


Open collector output logic '0' 
voltage 




0.4 


V 


Vol 


Output logic T voltage 


2.4 




V 


lo 


Output current 


± 100 








Open collector output current 


4.0 


8.0 


uA 


l<u 


Output off state leakage current 




±20 


hA 


I w 


Input leakage current 




± 10 


mA 


c„ 


input capacitance 




5 


PF 




OutpuUlO capacitance 




5 





Table 72. TTL (5 V) DC Characteristics 
' AC input parameters are measured at a 1 A V measurement level 

' <0 * loOCmi,, 

A c This is the steady slate drive capability of the interface. Transient currents ma be much 

greater. 

' When asserted the open collector IRQoutput pulls down with an impedance of 100 0 
or less. 

CMOS (5 V] Levels 

For CMOS inputs is approximately 70% of Voo and is approximately 30% of V m . 
The values shown in Table 73 are those for V w and V, L at their respective extreme limits 
of operation. 



,3/C? . 
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Symbol 


Parameter 










Input logic T voltage 


3.68 


VDD + D.5 


V 




Input logic "0' voltage 


GND • 0.5 


1.43 


V 




Output logic 'V voltage 






V 


V DO -0.4 




V* 




Output logic '0' voltage 




0.1 


V 




0.4 


V 


U~ 


Input leakage current 




±10 


*«A 




Input capacitance 




5 


pF 




Ouipw/IO capacitance 




5 


pF 



Table 73. CMOS (6 V) DC Characteristics 

1 t ,h s 1 mA 
b \ w i A mA 
c l 0L i 1 mA 
1 l 0L < A mA " 



LVTTL (3.3 V) Levels 



Symbol 


Parameter 


Min. 


Ma*. 


Units 




Input logic '1' voltage 




VCC + 0.5 


V 




Input logic '0' voltage 


GND -0.5 


0 6 


V 




Outpui logic '0' voltage 






V 


V OM,oi. m 


Output logic '1' vollaqe 






V 




Outpui current 


t 100 




*A" 




Output off state leakage current 




= 20 






tnpul leakage current 




±10 






Input capacitance 




5 


PF 




OutputflO capacitance 




5 


pF 



Table 74. LVTTL [3.3 V) DC Characteristics 
' AC input parameters are measured at s V measurement level 
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* This is 1he steady slate drive capatiiny of ;ne interface Transient currents me be much 
greater. 

Clock Signals 

The present invention uses one dock (SYSCLOCK) for almost all orvehip functions. Since 
this clDCk is used by the video output circuitry, it is assumed that s 2? MHz clock will be 
used so that the VTG (Video Timing Generator) will produce pictures at the correct rate. 

A second dock (CDCLOCK) may be used to clock coded date into the present invention 
This dock may be synchronous to SYSCLOCK and this allows data to be transferred into 
the system from circuitry that is not operating on the 27 MHz clock (perhaps a clock derived 
from a disk Dr network interface circuit). 

Internally, the invention derives high speed clocks for drivino the SDRAM interface usino 
a phese locked loop (PLL). This dock is output ol the SDRAM as DCLKOUT. An Dn-ehip 
Ei^?»?]? Q used 10 derivc 3n even mark -sP a =* ra'ic- The requiremenis for the 
SYSCLOCK are shown in Figure 101 . 





Characteristic 


27 MHz 


Unit 


Note 


Min. 


Max. 


1 


Clock period 


37 








2 


ClDCk high period 


10 




ns 




3 


Clock low period 


10 


I ns 





Table 75. Input Clock Requirements 



Reset Signals 

The present 



1) RESET 

2) VTG RESET 

3) TIMERESET 



RESET is the mam chip reset signal. All circuitry is reset and adopts the reset state 
indicated in the various tables as described herein. RESETmusl be asserted (LOW) for 
at least four clock cycles after the power and Cocks are stable to ensure e correct reset 



■2.x J 
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VTGRESET is used lo reset the video timing generator of the present invention without 
affecting other aspects of the present invention. 

TIMERESETis used by the timestamp handling circuitry in accordance with ihe present 



# 
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Introduction 

The ceded data interface, in accordance with the present invention, provides a dedicated 
set of pins that may be used to supply the coded video daia to system. Alternatively coded 
data maybe written via the microprocessor interface. This section discusses both of these 
methods. 

If the dedicated pins are used, coded data may be supplied either as a simple stream of 
bytes or as Tokens." The Tokens allow other types of information 10 be supplied in 
addition to the coded data. For example, lime stamp information may be transferred usina 

this mechanism. a 



If the microprocessor interface is used for coded data, then Tokens are always used 
Furthermore, this is quite simple. Once a "Token Head" has been written 10 declare that 
subsequent data is coded data (requirino just two reg.slers to be written) coded data may 
thereafter, be simply written into a register. r ' 

Coded Data Interface Signals 

Table 76 defines the coded data interface signals used in the present invention. 



Signal Name 


Type 


Description 


CDI7:0] 


1 


Coded data is supplied to the present invention one byte at a 
lime. Data is sampled at the rising edoe of CDCLOCK 
Dats is assumed to be byte-aligned. 


CDEXTN 


1 


When the coded dais interface is used to transfer Tokens 
this signal is the extension bit. This sianal is sampled Bl the 
same time as CDf7:0J. 


CDVALID 


1 


CDVALID is sampled at the same time as CD[7:0J. When ii 
is HIGH, the data is valid and is used as CDded data When 
it is LOW, the dats is not valid snd is ignored by the system 


CDACCEPT 


0 


CDACCEPT indicates tne readiness of the system 1o accept 
data. When il is HIGH, at 1he rising edge of CDCLOCK data 
will be latched as expected. When it is LOW the system 
cannot accept the data (presumably because' its internal 
again* ^ ^ therefore ' lhe dat3 snould be presented 


BMODE 


1 


When this signal is HIGH, data is interpreted as a simple 
stream of coded data bytes (and CDEXTN is ignored). When 
il is low data Is interpreted as Tokens. This signal is sampled 
al the same time as CDp:0]. 
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Signal Name 


Type 


Description 


CDCLOCK 




This clock is used Id control the transfer or Oaia into the 
system. CDR:DJ CDEXTN. BMODE and CDVALID are 
sampled ai the rising edge of CDCLOCK and external 
circuitry should sample CDACCEPT etthe same time. 

Note that in the default (reset) condition, CDCLOCK and 
5YSCLOCK must be connected to the same signal. 



Table 76. Coded Data Interface Signals 

CDVAUD and CDACCEPT are used to control the transfer of data in accordance with the 
present Invention. This type of protocol is referred to as a -two-wire' interface Both 
signals must be high at the rising edge of CDCLOCK in order for a data transfer to occur 
CDVALIC ^a S ^D^CEPT nSriiP DetWee " ,he CDEXTN and BMODE) and 

Note: If data is to be supplied via the coded data interface pins, the micropocessor 

interface register ■enab!e_mpi_input" must be zero (this is its reset state). 
Byte Mode 

In the present-invention, if BMODE is sampled HIGH at the risino edge of CDCLOCK rand 
COVALID and CDACCEPT are both high), then the daia is treated II fimpTe coded data 
In fact, the data is immediately buill inlo a DATA. In this case. CDEXTN is ignored. 

Token Mode 

JlA^fJ 5 ssn, P |Bd L0W ' 31 ,ne fisin 9 ed 9 e of CDCLOCK (and CDVALID and 
CDACCEPT ere both high), then the data is treated as Token*. 

of^nd*™ 
. Token at the coded data input. 

All Tokens in accordance with the present invention, consist of a series of bytes I CDD-Gll 

fndES. f S50d fw Wth ' 3n eX ' enSi0n b " < CD ^™>. The £s. b*etf the 
Token indicates the type of information carried Dy the Token. The last byte of the Token 
is indicated by the extension bit being LOW. ' 

For example coded data is supplied using the DATA Token. This is illustrated in Fiaure 
5h( 7T' th !r ,rS J byle is 0X04 < indi ^^9 that this is a DA™ Token) to! 

S BMODE ifs mLO^T "* ^ '"'^ " "* ** « 3 Token assuming 
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Another Token that is particularly useful is the FLUSH Token. This Token acts like a 
■reset" and it may be used after the end of one video stream in order to ready the system 
for the next video stream. The FLUSH Token is illustrated in Figure 104. 

Supply Data via the Microprocessor Interface 

In the present invention, tokens can be supplied to the system via the microprocessor 
interface (MPI) by accessing the coded data input registers Table 77 defines the coded 
data input registers. 



• 



£ 
1 


1 Bit No. 


1 
S 


Register Name 


Description 


04 


7 


Ron 


coded_busy 


The state of this registers indicates if 
th« system is able to accept Tokens 
written inio coded_dataf7:0]. 

The value 1 indicates that the interface 
is busy and unable to accept data. 
Behavior is undefined if the user tries 
io write to eoded_data when 
eoded_busy » 1. 




6 


RW/O 


enable_mpi_input 


Controls whether coded da:s input to 
the system is via the coded dats port 
(0)or via the MPl (1). 






RW/x 


coded_extn 


The extension bit of the token data 
written into coded data. 




<:0 


(not used) 






05 


7:0 


RW/x 


coded_dals 


Token data is written into this location 



Table 77. Coded Data Input Registers 



Writing Tokens vis the MPI 



The coded data registers are grouped into two bytes within the memory map Id 2llow for 
efficient data transfer. The 8 data bits, coded_data[7:0], ere in one location and the 
control registers. coded_busy, enablejnpi-input and coded extn are in a second 
location. (See Table 56 ) 



*'6 
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When configured for Token input via Ihe MP!, the current Token is extended with the 
current value of cod*d_extn each time a value is written into coded data{7:D] Software 
is responsible for setting coded_extn to 0 before the last word of any Token is written to 
coded_datar7:0]. 

For example, e DATA Token is started by writing 1 into codeo*_extn and then 0x04 into 
coded_datar7:0]. The start of this new DATA Token then passes intD the system for 
processing. 

Each time a new 6 bit value is writien to coded_dsta[7:0j, the current Token is extended 
coded_extn need only be accessed aoain when terminating the current Token (for 
example, to introduce another Token). The last word of the current Token is indicated by 
writing 0 to CDded_extn followed by writing the last word of the current Token into 
coded_data[7:0]. 



£ Switching between Input Modes 

Provided suitable precautions are observed, it is practical to dynamically chance the data 
tnDUt mode. In nenersl the transfer n( s Tot-an ui= snvnu m.ui, .... , . 




Jed_dataF7:0]. coded_busy should be inspected 
more data 




any one route should be completed 
•e shown in Table 76. 
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Previous Mode 


Next Mode 


Behavior 






The on-chip circuitry will use the last byte supplied 
in byte mDde as the lasi byte of the DATA Token 
thai it was ccnstructino (i.e., the extension bit will 
be set to 0). Before accepting the next Token. 


MPI input 






The Dff-circuitry supplying the Token in Token 
mode is rresponsible for completing the Token 
(i.e., with the extn bit of the last byte of 
information set to 0). Before selecting byte mode. 


MPI input 


Access to input via the MPI will not be granted 
(i.e.. coded_busy will remain set id 1 ) until the off- 
chip circuitry supplying the Token in Token mode 
hes completed the Token (i.e.. with the extension 
bit of the last byte of information set Id 0). 


MPI input 


Byte 


The control software must have completed the 
Token (i.e.. withthe extension bit.of the last byte of 
information set to 0) before enable mpi input is 
set too. 


MPI input 



Table 78. Switching Data Input Modes 



The first byte supplied in byte mode causes a DATA Token header to be generated on- 
chip. Any further bytes transferred in byte mode are appended to this DATA Token until 
the input moae changes. The MPI register bit coded_busy and the sional coded accept 
indicated on which interface the system is willing lo accept data. Correct observation of 
these signals should ensure that no data is lost 



Rate of Accepting Coded Data 

The input circuit of the present invention passes Tokens to the stan coded detector This 
m rrri^Jl th l DATA Tokens anci its normal rsle oi Passing is one byte per clock 
(of CDCLOCK). However, extra processing cycles are occasionally required For 
r X nir<fe J?^, 2 S , tar1 COdS ' S encounlere! * ' n lh * coded data. When this occurs 
CDACCEPT will go low to indicate that data cannot be accepled. 

y^FUZ? ^CLOCKmust nave * «Qher ciock frequency than the rate at which bytes 
of data are to be supplied to the sysiem. In many applications, it will be appropriate to use 
shownln S?e ?of " ^ SYS ^° CK and CDCLOCI^ One example^* 
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Coded Data Interface Timing 

Similarly, Table 79 shows the coded data interface liming for ihe present invention 





Characteristic 


2T MHz 


Unit 


Note 


Min. 


Mass, 




CDCLOCK cycle 


37 




ns 




2 


CDCLOCK low 


17 




ns 




3 


CDCLOCK high 
time 


17 




ns 




4 


CDACCEPT drive 




23 






5 


CDACCEPT holO 
time 


2 








6" 


input signal sei-up 
time 


5 








7 


Input signal hold 
time 


0 









Table 79. Coded Data Interface Timing 

' These timings need not be observed in some circumstances 
Maximum signal loading is 20 pF. 

The coded data interface uses CMOS levels. 
CDCLOCK 

The transfer of data across the coded dala interface is controlled by CDCLOCK which mav 
t £T 10 f" ™ in VidBO de «**r clock (SYSCLOCK). This S?may^ useful 
in allowing the system decoder to operate on a different clock to the video clock. 

However. CDCLOCK is also used internally in the present invention to clock circuitry such 

Loop (PLL) to ensure even mark-space ratio, external circuitry musl be used to ensure this 
or the timing parameters 2 and 3 shown in Fiaure 105. 



!¥ 8 - 1 7 2 6 2 4 



In situations wnere CDCLOCK and SYSCLOCK do not need to be synchronous the facility 
exists to drive the ritemal circuitry such as the start code detector from the PLL rather than 
CDCLOCK. This frees the external circuitry irorn the need to guarantee the even marked- 
spaced ratio. 

Figure 105 shows the internal arrangement which allows the even mark-space ratio clock 
generated by the PLL to be routed to the start code detector in place of CDCLOCK. 

If un_named_register is 0 (reset condition), the start code detector is clocked from the 
PLL.~tn this case, both CDCLOCK and SYSCLOCK musl tie connected to the same 
signal. The AC timing requirements for SYSCLOCK 

If un_named_register is 1. the start code detector is clocked using CDCLOCK In this 
case. CDCLOCK may be synchronous to SYSCLOCK. CDCLOCK musl obey the timinos 
at specified in figure 105. y 9S 
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Introduction 

The video output' interface of the invention implements a digital output interface ths' 
complies to CCIR Recommendatens 601 and 656. All of the synchronization and blankino 
information is included, in the form of special code words (SAV and EAV). in the same byte- 
wide stream of data as the video information . 

In addition, separate sync and blanking pins are provided so that the system may oe 
connected directly to a wide range of devices (such as video DACs or NTSC encoders) 
The timing of these signals is suitable for the generation of a video sional that complies with 
CCIR Recommendation 624. 

The video data may be time-multiplexed on a single byte-wide bus. Alternatively, a sixteen 
bit output mode a provided, in which case, the luminance data is output on one byte wide ■ 
bus while the two color difference signals are time multiplexed on a second byte wide bus. 



Video Output Signals 



Name 


Type 


Description 1 


Y[7:0] 


0 


Luminance output data 


C[7:0] 


0 


Cr/Cb output data — 


HCSYNC 


0 


Horizontal Or composite sync. The microprocessor register 
hs_not_cs controls wnich sync is present on this pin. 

The register hcsync_ah controls the polarity of this signal. 


VSYNC 


0 


Vertical sync. ~ 
The register vsync_ah controls the polarity of this signal 


CBIANK 


0 


Composite blanking. 

The register cblank_ah controls the polarity of this signal 


YE 


0 


When sampled high at the rising edge of SYSCLOCK, the Y 
(and in 15 bit mode the Cr or Cb) data is va/id 



Ja/ 
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CB/CR 


0 


In 16 bit mode, this signal indicates which color component 
(Cror Cb) is present on the Cp-.O] pins when YE is sampled 

In 8 bit mode the signal indicates which color component (Cr 
or Cb) is preseni on the Y[7:0] pins when YE is sampled low. 


V16/8 




Used to select the 16 or 6 bit output modes. 16 bit mode is 
selected when V16/B is HIGH. 8 bit mode is selected when it 
is LOW. 


NTSC/PAL 




Selects which of two standard rasters are to be produced 
When NTSC/PAL is HIGH, a 525-line raster is produced.' 
When it is low, a 625 line raster is produced. 

Note that this pin also affects other aspects of the operation of 
the present invention. 


VTGRESET 




This signal may be asserted to reset the on-chip Video Timing 
Generator. This may be used to lock the video liming to 
some external constraint. " i 



Table BO: Video Output Interface Signals 



Figure 107 shows the output timing in 16 tail mode. Figure 106 shows the output timing in 
B bit mode. 



Video Output Control Registers 

Video output control registers, in accordance with the preseni invention as shown in 













X 


c 

5 


1 


Register name 


Description 












18 


7:0 


rw; 
OxCO 


border_cb 


Cb component of border color 


19 


7:0 


RW/ 
0x80 


border_y 


Y component of border color 


1A 


7:0 


RW/ 
0x40 


border_cr 


Cr component of border color 



2*2 
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# 



X 


6 


dir/rcset 


Register name 


Description 


1B 


7 


RO/x 


vblank 


This is a read-only bit (data written Id this bii 
is ignored). It indicates vertical blanking. 




€ 


RW/O 


blank_screen 


When set to 1. this bit causes border cdor to 
be painted over the entire screen, thereby 
blanking the screen. Note that decoding 
continues as normal, but the decoded 
pictures are rendered invisible. 




5 




enbi_ssv_eav 


Controls the generation of SAV and EAV 
control words in the output stream. 

0 suppresses SAV and EAV. in which case 
blanking values are output at the times when 
SAV and EAV would otherwise be generated. 

1 enables SAV and EAV. Note that 
blankingGOl should also be set to 1 to avoid 
Ihe value zero appearing st the output, except 
during SAV and EAV. 

For CCIR 601 data, this pin must be set to 1. 




4 


RW/O 


blanhingSOl 


Controls the value of luminance' data thBt is 
output during blanking. 

0 selects the value zero. 

1 selects the value 0x1 0 (sixteen). 

For CCIR 601 data, this pin must be set to 1 . 


IB 


3 


rw;o 


cbiank_ah 


Controls the polarity of the CBLANK pin. 

0 selects active low 

1 selects active high 



A*3 
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I 

i 


S 


T 




Description 




2 


RW/O 


vsync_ah 


Controls (he polarity of the VSYNC pin. 

0 selects active low 

1 selects active hioh 






RW/O 


hcsyne_ah 


Controls the polarity of the HCSYNC pin. 

0 selects active low 

1 selects aclive high 




D 


RW/O 


hs_not_cs 


Controls whether horizontal sync or 
composite sync is present on the HCSYNC 

pin. 

0 selects composite sync 










1 selects horizontal sync 


1C 








(VUP sample mode) 



Tahlt 81: Video Output Control Registers 



Borders, Scaling and Cropping 

^ pf fo^?' inve ;?!;? n tempts to always produce a picture for display that is 720 pels by 
either 480 lines (525 line raster) or 575 lines (625 hne rasler). The invention automatically 
scales the decoded picture in order to attempt !□ fill this are£. 

?'7? e .^ nly 3 " mi<ed number of £cale 'actors are supported, it will not always be possible 
to fill th,s area precisely, ff the resulting picture is too small, then a border will be painted 
around the decoded picture. This border will be such that the decoded picture is in the 
center of the screen. 

Conversely, rl the scaling produces a picture thai is too big, then the picture is cropped to 
enable it to be displayed properly. The displayed region is the center of the decoded 
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picture. This cropping is limited so mat not more than approximately 10% Of the decoders 
picture is cropped If more than this would be lost, then a smaller scaling factor is used 

The border color may be selected by writing to the registers border cb, border v and 
border_cr. After the device is reset and before any pictures have been decoded the 
enlire screen will be filled with the border color. In addition, it is possible to paint border 
color over the entire screen by writing lo blank_screen. This may be used to hid* thi 
video during, for instance, a channel change. ae ■ e 



Video Output Characteristics 

Characteristics 

Figure 109 illustrates, in accordance with the present invention, the timing of the video 
output interface. Similarly. Table 82 iflusirates the video output interface liming 



Num. 


Characteristic 


27MHi 


Unit 


Note 


Min. 


Max. 


8 


Output drive time 




23 


ns 




g 


Output hold time 


2 








10 


VTG RESET se, - u P t,m * 


5 








11 


VTGRESET hold time 


0 




ns 





Table 82; Video output interface timing 



Maximum signal loading is 50 pF 

Failure to meet this timing parameter will 

cycle, on which the resel will occur VT( 



... tainty in the precise clock 

• — • • 1 is provided with an on-chiD 

KeteMs nolotsfXed S9ainS1 me ' astability prob!ems in ,he e ^l "™ this timing 



parameter is not observed. 
JX* 3 defin * S VWe0 ° U|PU1 m ° de Si9na,S ' F,gure 1 10 shows the v '^o output mode 
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r 



Num. 


Characteristic 


27 MHz 


Unit 


Note 


Min. 


Max. 


12 




5 




ris 





Table B3: Vid»o Output Mode Signals 
Operation is undefined if NTSC/PAL or V16« change state after reset. 



Video Signal Timing 



it the resulting video output complies 



• CCIR Recommendation 601 

• CCIR Recommendation 656 

• CCIR Recommendation 624 

Horizontal Timing 

The horizontal timing is shown in Figure 111 The numbers are in SYSCLOCK cycles for 
the 525 line system (625 line system (625 line system in parentheses). 

During equalization, the HSYNC signal is LOW for 62 cycles (66 cycles in the 625 line 
system). 

During field synchronization, the HSYNC s.onai is LOW for 722 cycles (736 cycles in the 
625 line system) 

Vertical Timing 

I^rl 03 ^," 9 is J"V stra,ed in Fl 9 ure 1 12 for the 525 line (NTSC) system and Fioure 
1 13 for the 625 l.ne (PAL) system, in these drawings the numbers down the left hand side 

snd v lo be found m the SAV and EAV codes (see CCIR Rec. 601 ) 

numbers or the decoded MPEG picture. These ere. therefore numbered 0 to 479 for the 
Se mfSiem" " 5 *** ^ "* 90 '° 575 for 57 6 !ines uied in tie 6?! 

f£»?iVr . St TS! ¥ *«Si B « timIn9 0f ,he sync snd blankin 9 Pinain^Jhe 52£Jinfi_si!Stem and 
« 2" t 1 15 f ^ the 625 ,lne SySlem Note ^ anl r one C HSYNC or CSYNrC may be 
output (see hsnot_.cs) and that the polarity of each of these signals may be inverted (see 
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VTG Reset State 

In the invention, the VTG resets to the stert ot line A (or the £25 line {NTSCi system and 
to the start of line 1 for the 625 line (PALI sysiem. 



#1¥8- 1 7 2 6 2 4 



A standard byte wide microprocessor interface (MPI) is used in accordance with th* 
present invention. The MP! operates synchronously lo the various decoder chip clocks 

MPI Signals 

Table 84 depicts the MPI interface signals. 



Signal Name 


Type 


Description 


ME[1:0] 


Input 


Two active low chip enables. Both must be 
low to enable accesses via the MPI. 


MRW 


Input 


HIGH indicates a read from a reoister on the 
system. LOW indicates a write to a register 
on the system. 

This signal should be stable while the chin is 
enabled. K 


MAJ5:0) 


Input 


Address specifies one of the locations in the 
chip's register map. 

This signal should be stable while the chip is 
enabled. 


MD{7:0] 


Outpul 


8 bit wide ciaia I/O pon. These pins are hioh 
impedance if either enable signal is HIGH.' 


IRQ 


Output 


An active low, open collector, interrupt 
request signal. 



Table B4. MPI Interface Signals 

MPI Electrical Specifications 

DC Characteristics 

See 2.2.1.TTL (5 V) levels." 

Figures 123 and 124 illustrate the read and write timing of the MPI. respectively. 
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AC Characteristics 

Table 85 shews the Reed Timino for the MPI. 



Num. 


Characteristic 


Min. 


Max. 


Unil 


Notes* 


13 


Enable low period 


100 








14 


Enable high period 


50 




ns 




15 


Address or rw set-up to chip enable 


0 




ns 




IS 


Address or rw hold from chip disable 


0 




ns 




17 


Output tum-on time 


20 




ns 




18 


Read data access time 




70 


ns 




19 


Read data hold time 


5 




ns 




20 


Read data tum-fftime 




20 







Table 85. Microprocessor Interface Read Timing 



The choice, in this example, of MHO] to start the cycle and MBit to end it is arbitrarv 
^ These signals are of equal status. y ' 
The access lime is specified for a maximum load of 50 pF on each of MDp;0]. Larger 



Likewise. Table 86 shows the write liming for the MPI 



Num. 


Characteristic 


Min. 


Max. 


Unit 


Notes ~j 


21 ■ 


Wrile data set-up time 


15 




ns 




22 


Write data hole time 


0 




ns 



Table 86. Microprocessor Interface Write Timing 



Sr^ 
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Interrupts 

"event" is the term used to describe an on-chip condition thai a user mioht want to observe 
An event could indicate an error condition or it could be informative io user software 

There are two single bit registers associated with each interrupt or "event" These are the 
condition event register and the condition mask register. """" ' *' i; 

Condition Event Register 

The condition e«ent register is a one bit read/write register whose value is set to one bv a 
condition occurring within the circuit. The register is set to one even if the condition only 
existed transiently. The register is than guaranteed to remain set to one until the user's 
software resets it or the entire chip is reset. 

• The register is set to zero by writing the value one 

• Writing zero to the reglsier leaves the reoister unaltered 

• The register must be set to zero by user software before another 
occurrence of this condition can be observed. 

• The register will be reset to zero up on reset. 

Condition Mask Register 

JJ» condition mask register is a one bit read/write register wh,ch enables the generation 
of an interrupt request rf the corresponding condit.on event registers) is (are) set If the 
condition event is already set when 1 ,s written to the condition mask regisier. an interrupt 
request will be issued immediately. v 

• The value 1 enables interrupts. 

• The register clears to zero upon reset. 

Unless stated otherwise, a block will stop operation after general ino an interrupt request 
and wj re-stan soon after either the condition event or the condign mask regis^r are 

Event and Mask Bits 



^ . „ , s^v^ Mum ii up mess* i c u i sic r5 as a n 

H registers to identify which event generated the interrupt. 
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The Chip Event and Mask 

The present inveniion has a single "global" event bit that summarizes the event activity on 
the chip. The chip event register presents the OR of al! the on-chip events that have 1 in 
1heir mask bit. 

A 1 in the chip mask bit allows the chip to generate interrupts. A 0 in the chip mask bit 
presents any on-chip events generating interrupt requests. 

Writing 1 or 0 to the chip event has no effect. II will only clear when al! the events (enabled 
by a 1 in their mask bit) have been cleared. 

The IRQ Signal 

The IRQ signal injhejnvention is asserted if both the chip event bit and the chip event 
rr if^, are 71,1 1RQ ? 9nal is an a <*veJow. "open collector" output which requires an 
off-chip put -up resistor. When active the IRQ output is pulled down by an impedance of 
. or less - A P ull " u P r esis'or of approximately A kO should be suitable for most 
applications. 

Page Register 

In order to reduce the number of register address signals required by the present invention 
a page register is employed to enable more than 64 regisiers to be addressed This paoe 
register is at location 0x1f. Register locations 0x00 Id Oxlt are not affected by the contents 
of the page register and are always present in the register map. Registers in locations 
0x20 to 0x3f depend on the page register. 

There are no paged registers that are required for normal device operation The Daoed 
registers are, finally, only used for test purposes. PB 

in the invention, the page register is reset to the value zero. The user should ensure ih=t 
no other value is written to this register. 



33 / 
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Introduction 

SDRAM Interface Signals 

Table 87 illustrates the SDRAM Interface Signals. 



Signal Name 


Type 


Description 


DD|15:0] 


\IO 


Data pins 


DA[10:0] 


0 


Address pins 


BS 


0 


Bank select. Often this is labeled as A[1 1) Dn 16 Mbit 
SDRAM parts 


DCKE 




Clock enBble 


DCLKOUT 


0 


SDRAM clock output. 


DCLKIN 




Connect to DCLKOUT 


DWE 


0 


Write enable 


DCAS 


0 


Column address 


DRAS 


0 


Row address 


DCS|1;0} 


0 


Chip select. DCS(O) selects the first "bank" of SDRAM If a 
second^bank" is used (see SDRAM configurations 1 and 2) 
then DCS|l) is also used. 



Table 87. SDRAM Interface Signals 



SDRAM Configurations 

Table B8 illustrates SDRAM configurations. 



Configuration 


SDRAM Packages 


Total DRAM 


Organization 


0 


1 


16 Mbit 


16 Mbit, 1 Mby 16 bits 


1 


2 


20 Mbit 


16 Mbit, 1 Mby 16 bits 


<S Mbit, 256 k by 16 bits 


2 


2 


32 Mbit 


1 6 Mbit, 1 M by 1 6 bits 


1 6 Mbit. 1 M by 16 bits 


3 


2 


32 Mbit 


16 Mbit, 2 Mby 6 bits 



J3J 
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Configuration 


SDRAM Packsoes 


Total DRAM 


OrDamzstion 






r 


16 Mbit. 2 M by S bits 



Table 88. SDRAM Configurations 



Configuration Zero 

See Figure 116 for the Configuration ZBro SDRAM Connection. 

Figure 117 illustrates the configuration lor one SDRAM connection. Similerly Figures 
and 1 19 dep.cl a configuration of two anQ three SDRAM connections, respectively 
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Introduction 

The system, in accordance with Ihe present invention, fully suppons the Joint Test Act™ 
Group (JTAG} "SiandardTest Access Pon and Bounds Scan Architecture^ no* a*$S 
by the IEEE as standard 1 149. 1 . v a 

AJIJTAG operations are performed via the Test Access Pon (TAP), which consists at fii» 
pins. The TREST (Test Reset) pin resets the JTAG circuitry to ensure that the device 
doesn't power-up m test mode. The TCK (Test Clock) pin is used lo clock serial test 
patterns into the TDI (T est Data Input) pin. and cut of the TDO (Tesl Data OulDuti Din 
Furthermore, the operational mode of the JTAG circuitry is set by c ockino the eS 
sequence of bits into the TMS (Test Mode Select) pin 9 sppropna,e 

The JTAG standard is extensible to provide for additional features at (he discretion of the 
ch.p manu^cturer In accordance with the present invention, tnere are S user tat^ionY 
S^J hfee f J J AG mandat ° r y -nstructJons. The extra instructions allow " S? j 
,eSl,n9 10 * P eriorme ^ ai * Port* additional eternal test flexibility Fo 
example, all dev.ce outputs may be made to float by e s.mple JTAG sequence See Table 



Connection of JTAG Pins in Non-JTAG Systems 



Stanal 


Direction 


Description 


TRST 


Input 


This pm hss an internal pull-up. but must be 
taken low at power-Up even it trie JTAG features 
are not being used This may be achieved by 
connect.no TRST , n common with the chip reset 
pin RESET. 


TDI 


Input 


These pins have imernsi pull-ups, and may be 
left disconnected if the JTAG circuitry is not 
being used. 


TMS " 


TCK 


input 


This pin does not have a pull-up. and should be 
tied to ground if the JTAG circuitry is not used 


TDO 


Output 


High impedance except during JTAG scan 
operations If JTAG is not beira used, 1 his pin 
may be left disconnected P 



Table 89 How to Connect JTAG Inputs 
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Supported Instructions 

This section describes the instructions supported in this implementation of the octant 
invention. See Tables 90. 91 . and 92. e present 



Instruction 


Description 


£XT£ST 


This is the most basic instruction. It applies Data from the boundary ~~ 
scan chain to the PCB. and captures the response. It has a pre-deHneri 
instruction code, which is all-O's in the instruction reoister. 


SAMPLE/ 
PRELOAD 


\ n/s instruction allows the boundary-scan chain to be parallel-loaded 
from the device's pins, and shifted, without the boundary-scan chain 
being switched in, i.e. transparently lo system operation By this 
means, a "snapshot'' of the stats of the device's pins may be taken 
(external clock control required to avoid mestastability) or the 
boundary-scan chain may be pre-loaded before switching over into 
CATE5T mode. 

The instruction code for SAMPLE/PRELOAD may be chosen bv the 
manufacturer. ' 1 ,B 


BYPASS 


This inslruction selects the 1-bit bypass register, to by-pass the 
boundary scan chain, and thus reduce the length of bit-stream required 
to access other devices on the PCB The instruction code is ore- 
defined as all-rs. spre 



Table 90. Mandatory Instructions 



I Instruction 


Description 


jlNTEST 


Th,s does the reverse of EXTEST" . i.e. applies dsts from the 
boundary-scan chain to (he chip core, and captures the response 
The instruction code may be chosen by us. I; is up to the user to " 
devise suitable tests to make use of lh, s capebilily 



Table 91. Optional Instructions That Are Supported 
• following optional JTAG instructions are not supported; 

1) IDCODE 

2) RUNBIST 
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Instruction 


j_ Description 


FLOATBS 


This instruction pre-sets me Boundary-scan register to contain in ~ 
all open-dram cells, ana TJ- in all Diners The system operation is nol 

?? vSJW ' K l l an , DU ^ U, rf "i l MUMS the to float, this is 
a quick way of disabling all oulpuls (a common requirement for PCB 
testing). The outputs will not float until an instruction is loaded which 
switches in the Boundary-scan chain, e.g. EXTEST (if FLOATBS 
were to switch in the boundary-seen chain itself, unknown data would 
be driven out of the pins until (he UPDAT£_DR state.) 


INEXTEST 


Does the combination of INTEST and EXTEST. Perhaps riot very 
useful as we have individual versions anyway. It may allow sum 
users to devise 8 faster combined PCB/chip test. Many JTAG 
devices use this combined mode rather than separate versions 


SETBYP 


Selects the Bypass register between TD) & TDO. but switches the 
Boundary-scan chain in. This allows the PCB test to set up a 
constant pattern on one device s pins, but still access other device's 

plh£ without haviho lo reload the fir*! r(Aui>ia TK^ ■ . 

. y lw ,tlwiau tne i,ral oevice. i ne name is consistent 
with the same function in Texas Instrument's "Scope" JTAG devices 


SHIFTBN 


Like SAMPLBPRELOAD. but without the SAMPLE operation 
Allows ihe current Boundary-scan contents to be shifted some more 
without being overwritten. T. 1. have this insiruction in their Scope 
devices, but variously call it READBN or RBRNM neither of which is 
very intuitive 


SHIFTBT 


Like SHIFTBN. except that the Boundary-scan chain is switched in 
Potentially more useful than SHIFTBN. in thai it could be used for ' 
optimizing PCB test patterns f D r small bits of looic externally 
connected between JTAG devices. E g for a 2"-input aate near the 
far-end o, tnc chain, several test patterns could be rjueued-up in the 
Boundary-scan chain, and applied in turn. EXTEST. in contrasl 
overwrites ths BcunOary-scan contents on each scan cycle 



Table 92. Additional Public Instructions 
Allocation of Instruction Codes 

rS^lim ^ ,ined ins ^ c,ions together. Hence there is a 4-bit long insiruction 
BYPA«M^£ ^unassigned mstructions. Unassigned instructions ar e alfases of he 
BYPASS instruction, in accordance with IEEE1 H9,i. oi ine 

The full list of instructions and their codes is shown in Table 93. 
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Code 


Instruetipn 


Register 
shifted 


S.gnals 
capture 


| B/SCAN 


ClBM ' 


0000 


EXTEST 


B/Scan 


inputPads / 
Os 


switched In ■ 


MANDATORY 


0001 


SAMPLE/ 
PRELOAD 


B/Sean 


All Pads 


transparent 


MANDATORY 


0010 


INTE5T 


B/Scan 


OSI 

OulputPads 


switched in 


RECOMMENDED 


oovT" 


FLOATBS 


B/Scan 


O's 


transparent 


PUBLIC 


oioo - 


SHIFTBT 


B/Scan 


No change 


switched in 


PUBLIC 


0101 


SHIFTBN 


B/Scan 


No Change 


transparent 


PUBLIC 


0110 


INEXTEST 


B/Scan 


All Pads 


switched in 


PUBLIC 


0111 


unassignad 


Bypass 


0 


iransparent 


RESERVED 


1000 


PRIVATE 


1001 


PRIVATE 




1010 


SPDATAT 


ScanData 


Internal sigs 


switched in 


PRIVATE 


1011 


SPDATAN 


ScanData 


Internal sios 


transparent 


PRIVATE 


1100 


SETBYP 




0 


switched in 


PUBLIC 


1101 


unassigned 


Bypass 


0 


transparent 


RESERVED 


1110 


BYPASS 


Bypass 


D 


transparent 


PUBLIC 


1111 


BYPASS 


Bypass 


0 


iranspsreni 


MANDATORY 



Table 93. J TAG Instruction Codes 
Level of Conformance to IEEE 1149.1 
Rules 



adhered to, although the following should be noted: 



Rules 




3.1.1(b) 


The TRST pin is provided. _ 


3.5.1(b) 


Guaranteed for all public instructions (see IEEE 1 1 45 i 5 2 1(-)) 
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Rules 


Description 


5.2.1© 


Guaranteed lor all public instruction* For some private 
instruelions. the TDO pin may be active during any of the states 
Capture-DR. E»ti-DR t Pause-DR 


5.3.1(a) 


Power orwesei is achieved by use or the TR.ST pin. 


6.2.1 (e.f) 


A code lor the BYPASS instruction is loaded in (he Test-Lome 
Reset state. y 




Un-allocated instruction codes are equivalent to BYPASS 


7.2.1(c) 


There is no device ID register. 


7.6.1(b) 


Single-step operation requires external control of the system clock 


7.9.K..} 


There is no RUN8IST facility 


7.11. 


There is no 1DC0DE instruction. " 


7.12.l(...) 


There is no USERC ODE instruction 


S.1.1{b) 


There is no device identification, register. 


8.2.1(c) 


Guaranteed tor all public instructions. The apparent lenoth of the 
pain irom i ui to TDO may change under certain circumstances 
while private instruction codes tare loaded. 


8.3.1(S-i) 


Guaranteed for all public instructions. Data may be loaded a; 
times other men on the rising eoge of TCK while private 
instructions codes are loaded 


1041(e) 


During INTEST. the system clock pin must be controlled exiernally 


10.6.1(c) 


During INTcST, outpui pins are controlled by data shifted in via 




Table 94. JTAG Rules 


Recommendations 




Recommendations 




3.2. 1(b) 


TCK is a high-impedance CMOS input 


3.3.1(c) 


TMS has 2 high impedance pull-up 


3.5.1(d) 


(Applies to use of chip). 


3.7.1(a) 


(Applies to use of chip) 
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Recommendations 


_ Description 


6.1.1(e) 


The SAMPLE/PRELOAD instruction code is loaded durino 
Capture-IR. u 


7-2.1(0 


The INTEST instruction is supponed. 


7.7.1(g) 


2eros are loaded ai system output pinj durinp EXTBST. 


7.7.2(h) 


All system outputs may be set high-impedance. ~~ 


7.8.1(f) 


Zeros ere loaded at system input pins during INTEST. 


B.l.1(d.e) 


Design-specific test data registers are not publicly accessible 



Table Si. Recommendations Met 



Recommendation 




10.4.1(f) 


During EXTEST. the signal driven into the on-chip logic from! 
the system clock pin is that supplied externally. 



Table 96. Recommendations Not Implemented 



• 
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Permissions 



Permissions 


Description ' 


3.2.1(c) 


Guaranteed for ail public instructions. 


6.1.1(f) 


The instruction register is not used id capture desion-specifi- 
information. u 5pecni - 


7.2.1(g) 


Several additional public instructions are provided. 


7.3.1(a) 


Several private instruction codes are allocated. 


7.3,1 (e) 


(Rule?) Such instructions codes are documented 


7.4.1(f) 


Additional codes perform identically to BYPASS 


10.1.1(1) 


Each output pin has its own 3-siate control. 


10.3.1(h) 


A parallel latch is provided 


10.3.1(ij) 


via tdi EXTEST ' inpu1 pinS Sre cw1lro,letJ b y Sa,s &m * ti ,n 


10.6.1(d.e) 


statf 6 CB " £ f0fCed inaclive in lhe Test-Looic-Reset 



Table 67. Permissions Met 
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Introduction 

The start code detector (SCD), m accordance with the present invention, has the task of 
detecting start codes in the coded data stream, it ccnvens these to Tokens for further 
internal processing by the system uner 



Start Code Detector Registers 



Table 98 illustrates the registers for the start code detector of the present invention. 



• 


1 

1 

< 


6 
£ 


Dir/reset 


Register Name 


Description ■ 




05 


7 


RW/0 


scdp_access 


This bit must be set to one before 
the values in register location 
0x07 may be written to reliably 
This causes the SCD to stop 
processing data sd that there is 
never any contention between the 
microprocessor access and eny 
attempt by the SCD to mooify the 
registers itself. 

Once the value one has been 
written to scdp_access, ihe 
microprocessormust poll 
scdp_access and wait until It 
reeds beck 1. 


• 










Once ihe required accesses neve 
been made to location 0x07, the 
value 0 should be written to 
scdp_access to enable the SCD 
to continue processing data. 






6 




(not used) 
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* 





8 

a 


1 


Register Name 


Description 




5 


RW/1 


diseard_extension 


When discard_ ex t e nsion is 1 
any extension data ihat is not " 
recognizee as MPEG-2 MP@Ml 
is discarded at the start code 
detector. When it is 0 such 
extension data is passed through 
the coded data buffer to the 
parser. 

Wfith the standard microcode, 
discard_extension to'!? 9 




4 


RW/1 


dlscard_user 


When discard_user is 1, any 
user date is discarded at the start 
code detector. When it is 0 used 

data buffer to the parser. 

Whilst facilities exist to handle 
small amounts of user data at the 

dlscard_user Is set to a^Nme 
that the system cannot deal with 
arbitrary amounts of user data 




3 


RW/O 


after_se«rch_stop 


Used in conjunction with the 
stan_corfe_search facility. 




2 


RWJO 


flag_picture_end 


This is set to " to eneblethe 
flag_picture_»nd facility. 






RW/0 


after_picture_stop 


Jsed in conjunction with the 
flag_picture end facility. 




0 


RW/O 


after_picture_discard 


Jsec! in conjunction with the 
flag_pjcture_end facility 


07 


7:3 




nol usee!] 






2 


RW/O 


discard_all 


This is se1 to 1 to enable the 
drscard_all facility. 
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I 

1 




Dir/raset 


Register Name 


Description 




1:0 


rwvo 


s tart_c ode_se arch 


A non-zero value in this register, 
enables the start_c 0 de_ 3 earch ' 
facility. See 8.5 on page 84. 


00 


7 


_ 


Cnol associated with the start 


code detector) 




5 


RW/0 


end_s-earcri_event 


This bit is set whenever a 
start_code_seareh is satisfied. 
If end_search_mask is also set 
Id 1 then en interrupt will be 
generated.' 




5 


rw/o 


unrecognized_start_event 


This bit is set whenever an 
unrecognized start code is 
Selected. If 

unrecognized^start mask is 
also set lo ",. then an interrupt will 
be generated. 




4 


RW/O 


flag_picture_end_event 


This bit is set whenever the end 
of a picture is delected and 
f1ag_picture_end=1. It 
flag_picture_end_mask is also 
so! to 1 tnen en interrupt wilt De 
generated. See 8 4 on page e2. 




3:0 




(not associated with ihe siarl code detector) 


01 


7 




(no! associated with the start code detector) 




6 


RW/O 


end_search_mask 


See end search_event above 




5 


RW/O 


unreeogni2ed_start_mask 


See unrecognlzed_start_event 






RW/O 


flas_picture_end_mask 


See fiag_picture_end event 

above. 




3:0 




(not associated with the start e 


ode detector) 



Table 98: Stan code detector registers 
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• event bits are not simple R/W register bits 

1 all interrupts are conditional on chip_mask being s< 

Detection of Start Codes 



The present invention deals only with video start codes. Unrecognized start cade* »r» 
detected and cause an unrecoenized_start_eods ftverv i. The unrecoonizerj stan enrt« 
are the system start codes (with values OxbS through Oxff) the reserved start codes rr,vhn 
0xb1. end 0xb6) end the sequence_error_code fOxM). 0<3es {0xb0 ' 

discard_all Facility 

Ir?«i^f n B [ d r a ! l t i aC !l ity m ^ y be used 10 discard 311 dalB ,nat emers the system, it is 
^ Hoover 11 neLtlf ar ,K-f ^ " m&W ' * ^ «» «9»l«r d l«art a to 
i readTback ; r^ST 3 ^ Bcd P- aecess m ' JS1 first b * «et to 1 and then polled n 
Plcturfend fac^ " * W> '° enler ,hl£ m0de « P-rt S ,he S 

flag_picture_end Facility 

Figure 120 illustrates as e flow char, lheflag_piclure end iaciHv As shovw- it „, 
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start_code_search Facility 

In the invention, Ihe ECD can be set lo search for specific types d( si 

be used, for instance, aft u • 

decoding commences. 



start_code_s»arch 


Stan cedes that end the search 


0 


(none - normal operation) 


1 


picture_start_code. group_sfari code 
and sequence_start_code - 


2 


group_sian_code ana 
sequence_start_code 


3 


seouence_stari_coo'e 



Table 99. start_code_search Modes 

Jhe search mode is entered by writing a non-zero value into start code ssareh The start 
c^edetectorwll then search for me appropriate start codes a, inrfj^% rVbteBB a3 
, <J /° kenSared ' SCaraedwhilethe "arch continues. When one of the appropriate 

^ ^---^ > -« <° *E2S£ 

Note also that a FLUSH Token will terminate the search as if one of the indicate «.-h 
r 3d enc ° unle '<*- However, in the special case mat SL fJShtSJ^ 
tenmnanno the d.scard.al! function, ihe search is „ ot terminated. Funher this a^ owl a 

^*^,^SSM C ard - a " and E pf6vi0usly selec,eci ~S 

accordance with the 



as 5 flow chart the si2rt_code_search facility, ii 



SCD Example ■ Channel Change 

An example of the using the SCD facililles ir 



1 ' rT/rJS,^"!" 3 m ! cr °P'? ,:essor ^cognizes the need for a channel change (perhaps 
W^:J^iS^^ --P-essorU^se^ 

• I in to Jlsg_picture_end 

• l intoaft(r_picture_diicard 

• I in to flag_pictur t _end mask 
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When the nan code detector detects the end of the current pic-.ure. ii inwedi««k- S ani 
duevd all subsequent data The microprocessor is interrupted and determines that'the C n 
Of i he interrupt was n»8_piclure_tnd_ev C nt The microprocessor first prepares the jt 
code deiecior for the neu channel bv writing. 



Then the microprocessor reiunes the tuner 10 select the new channel. 

After the lati data from the old channel ij transferred into the system (and before the first 
data from the new channel) a FLUSH Token is inserted. [Ahematively the value 0 is 
wntten to discard_all.) The stsn code detector, therefore, stops discarding the data (from 
the old channel) and starts searching (the data from the neu. channel; for a sequence start 

code is detecied. the start code detector ceases discarding data and 
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Introduction 



The video parser, in accordance *«h the presen: imeraion. is responsible for decoding the video 
data stream. It is implememed as a microprogrammed processor 

In ihe normal cc 
applications ma 

Hoover, the video parser is able to notify the controlling microprocessor when it detects ur 
or unexpected events, such as bitstream errors In all cases. I he microcode includes code to re 
from (and conceal) errors so that it is safe to ignore biistreim errors However the knowled.fi 
bitstream errors are occurrine may be useful for diagnostic purposes ' 



Parser Registers 

The registers used by the parser aj shown i 



f 


1 


- 1 
S 


Register N'ame 


Description 


10 


7.1 


RW 


(parser_ctrl) 


S'o function allocked 




0 


RW 


p»rser_coniinue 


Used in cenain situations 10 indicate to the 
parser whether i: should continue with its 
current activity or return to normal decodine 




7,0 


RW 




I'sec to indicnc the status of the psrser in 
cenain conditions 




7:0 


RO 




This location contains an error code when the 
pzrser has micrrupted and is waiiine 10 be 
sen iced This indicates the reason for the 
interrupt 
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1 

I 


2 


Dir/resel 




Description 




13 


7 


RW.O 


pantr_acces$ 


The value 1 must be written to this register to 
enable access to the other parser reeiiiers. The 
comrollinji microprocessor must then pollihis 
oil until ii reads back the value 1 indicating that 
the parser has stopped processing dan and can 
be accessed 

.N'Ole that as a special case, if the parser is 
stopped uaitinj for ii interrupt lo be serviced 

writing 1 lo pnrstr_access 






6:0 


R\V 


reg_keyhole_iiddr 


This recisier is used to address the location in 
the parser's internal register file that may be 
written to or read from via reg_keyho.le data. 
Note thai each access (read or write) to 
reg_keyhole_dain increments 
res»_ke> hDle_ndclr by one. 






70 


R\V 


reg_keyhole_d;nn 


A read from this location actually reads data 
from the parser's regis. er file al the location 
indicated by reg_keyhole addr Similarly a 
write lo this location actually writes to the 
parser s rejj.ster file at the location indicated bv 
reg_keyholr_addr 




15 


70 




(not used) 




• 






RW 


uscr_keyhole_addr 


1 his register is used io address the location in 
the user data RAM that may be written to or 
read from via user keyhole data. Note thai 
each access (read or write) to 
user^kryhole_dnta increments 
uscr_kryhole_»ddr by one 




17 


7:0 


RW 


ujer_keyhole_dma 


A read from ihis location actually reads data 
from the user data RAM at the location 
indicated by reg_keyhole_addr. Similarly a 
"rite to this location actually writes to the user 
data RAM ai ihe location indicated by 
res kevbole addr. ' [ 




00 


7,-1 




(not assodaicci with the parser) 
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I 

1 


C 


■ ' 

O 


Register N 




Description 




3 


RWVO 




This bit is set whenever ,h e parler detects an ' 
error condition If parter mM k is also set to 1 
ihen an interrupt will be generated .* 




2:0 




(not associated 


with the parser) 


0! 


7:4 




(not associated 


with the parser) 




6 


R.WA3 


par!er_maik 




See paraer_eveni above 




30 




(not associated with ihc paisen 



Table 1 00. Parser Regijt 

I b»i= are not simple RAV register bits. 

all interrupts are conditional on chip_mask beine set to I 

Error Codes 
Whenever the parser detects 



vrnenever trie parser Detects an event condition, it sets p arS er_event If parser mask it s ,t .o 1 
(.ndieatine that the user system is interested in servicing parser events) iht parsefstops process™ 
and (assuming that chip_mask is set lo I ) an interrupt is generated P pr0 "" ln * 

On respond,™ to the interrupt the controlling microprocessor should read parser error code lo 
r«,™ ° flhe eV ' nt Tlb " F ° Vili " CDmpl " £ ]iS1 ° fdCf,ned c ™ in tris 

< o " uon[n \™" 0 V<x™<>' h« >«ponded to the event in the appropriate maruttr it must 
S W Vtt7the ^°Je' iTnTrs" mVemi ° n 10 rE5UmC Pr °" !SinS Th ' S ' S d ° nc b ? lhe "™ 



ERR_USER_DATA Indicates that user data has been 
I 8n| J » present in the user data RAM. 



Table 101. Parser Error Codes 



Dealing with User Data 
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Small amounts of user data may be read out from the parser By default, all user data is discarded 
by the nan code detector This isio proiect the system iron, the inappropriate use of laree amounts 
or user data which would he beyond its capabilities ' 

In order to allow user data to reach the parser the register discnrd_user musi be set 0 Whenever 
user data is encountered in the bitstream the bytes of data art buffered up in an on-chip user data 
RAM. The RAM hasspice for 192 bytes or data to be buffered When all of the bvtes ofuser data 
have been read (or the RAM is full) the parser will i-eneme an event (ERR L'SER DATA) which 
allows the controlling microprocessor to read the data from the R.AM 

Before the user data RAM is read, the microprocessor must first obtain access to the parser's internal 
registers by setting parser_»ccess to I and then polling this bit until it reads back 1 . The number of 
bytes in the user data RAM is indicated by p«rser_status The user-data RAM cannot be accessed 
directly. Instead, it is necessary lo write the address that is to be read into user keyhole addr 
(usually zero) then data is read from user. keyhald data. Since user keWiole addr is 
automatically incremented each time that a read is performed from user-kevhole data the 
appropriate number of bytes of user data can be read very quickly "e 

If there are less than 192 bytes of user data, then all ofthe dau is dealt uiih bv a sinule event If 
there are more than 192 bytes, then parser stums will contain N- bvtes 'the firci iim. .h,. 
ERR_USE R _DAJ A is generated After The event has been de'ared (bv I ^Vzero * 
dSVZwdo^x, ,0 p! ' rSer - tVe, " ) lhC P»r.er_c 0 - n ti„„, to 

S parser continue is 1 the parser continues dealing with user data The remainine bvtes of user 
data (or the nt» 192 bytes) are parsed from the st.eem and the process repeats" However if 
parser eont.nue s C I then the parser c.scards the remaining user dale and proceeds with normal 
vrteo decoding Note that even if p»rser_conlmue is aero, the first ERR L'SER DATA even; uill 
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Limiting the Amount or L'scr Dnt« 

3f it is intended thai user data should be used. i. is imponam that this is limited in order that the rcal- 
umt decoduii of video dita can be guaranteed in accordance with ihc prrsent invention It is very 
difficult to specify the acceptable limit on uier data since it depends t>r> many external constraint's 
such as the interrupt response time of the controlling microprocessor and the time taken to read i 
byte of data from the system As a guide, the amount of user data should be limhed to the amount 
that can be guaranteed to be read from the system in about 50^ [including interrupt response lime 



^ZV^J^lt f P t ' C daU ' '- h< U " r KkM ' S USed b * ,he mi »^°< processor for other 
S V? °l i°" CM i menI ™." on vec,ors - for in»"«). For this reason, it is no. possible 
to leave data ,n the RAM and expect it to be preserved for later use 



The present invention includes circuitry la assist in the management of video time stamps It is 
assumed thai the external circuitry associated ivith the MPEG system stream parser has recovered 
a stable 21 MHz dock by usinsj the clock references [PrDgrammed Clock Reference or System 
Clock Reference is appropriate ). 



The circuitry, in accordance with the prtsent invention, is. therefore, concerned with starting video 
decoding at the appropriate time to ensure synchronization with audio and. thereafter, monitorinc 
video timestarnps 10 ensure continued synchronization In the absence of errors no subseouent 
correction will be required * 

It is deiirahle to avoid the need to transfer clock reference information into the video decoder 

U^Z^iJn ?im, d «,""° "? 1 CirCUi ' wlK ,ht in P u > *"2« of the system for 

loading video time stamps and a real.nme counter that is associated with the video parser circuitry. 

System Organization 

?7 Im^vVr," nr^ in ^ U£leS 1 4 °r Un,er ,h *' * incrtrocmEd " re S ular inte ™>* <i'ri«d from the 
1 ^SJ &CLOa <- . *>™ m for timestamp management depends (conceptually) on a second 
copy of this counter being maintained outside of th, sysiem These two couraers are initialized to 
the same value by being reset by the same signal Thereafter, the two counters free-run. 

The present invention performs its limestamp management with respect to its internal time eounte- 
-!H?V , ^ de ° t " nt "- To assure that the correct comparisons are made, the video timestarnps are 
modified by the system decoder. It is not necessary to know the absolute time - simplv the 
difference between the actual time that a piciure is decoded and the nominal lime it should have'been 
decoded 

Equation 1 below denotes this by setting the difference between the video time counter and the 
modified time sump equal to ihe difference between the ac.ua] "Time" [derived from the clock 
references) and the t.mestamp Equation 2 is merely a reorganization of the variables to derive the 



videotime - modiriedtimestamp = timesiamp - time 
modifiedtimestamp = videotime * (timestamp - time) 



^ S 7 2 Sh ,° WS one P° ssible Denization of me arithmetic to derive trie modified time 
S"^' « '« ™*< B»ly ^' th. actual additions (and th. shift) will be performed 
,r ?ri« ,1 r2 ^ r ' han " ded,ca1ed hardware. There are. of course many other ways 
lo oenve the S3rne numeric v a(ue of the mod.lied lime stamp. For instance XrThsn 



ass 
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having a copy of t he videolime c ounter it may be better to simolv recnrd .h= , 
;i.m B », when the- RESET.T1ME p,n of the .nvem.on was KS^'' 
information and the current value of "time" it is always poss bie to d w ,h lh,s 
contents of video lime within (he system. V P * 10 * eauce the curren! 

It wiy be appreciated lhat any suitable rearrangement of arithmetic operations that v \*ir« 
a suitable value of the modified lime stamp may be used. "t^'ons tnai yields 

As shown in Figure 122, the modified t.mestamps used by the tnvention use only sixle ^ 
small, the more significant b is can be d scarded ^orwin dr.** .„ ""ways De 
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Figure £, 1$ 
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Figure £j£ 
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P V SD SB F V SD SB 




SD - select data Field sync 

SB = select border (dashed line is SB') Equalization sync 

F = digital field indicator analogue blanking 

V = digital vertical blanking (dashed line is V) inactive 
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F V SD SB F V SD SB 




SD = select dsu ' Field sync 

SB = select border (dashed line is SB') Equalization sync 

F = digital field indicator analogue blanking 

V «= digital vertical blanking (dashed line is V) inactive 
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ABSTRACT 

An MPEG video decompression method and apparatus utilizing a plurality of 
stages Interconnected by a two-wire interface arranged as a pipeline processing 
machine. Control tokens and DATA Tokens pass over the single two-wire interface 
for carrying both control and data in token format A token decode circuit is 
positioned in certain of the stages for recognizing certain of the tokens as control 
tokens pertinent to that stage and for passing unrecognized control tokens along the 
pipeline. Reconfiguration processing circuits are positioned in selected stages and 
are responsive to a recognized control token for reconfiguring such stage to handle 
an identified DATA Token. A wide variety of unique supporting subsystem circuitry 
and processing techniques are disclosed for implementing the system, including 
memory addressing, transforming data using a common processing block, time 
synchronization, asynchronous swing buffering, storing of video information, a 
parallel Huffman decoder, and the like. 



